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rP ! Abstract 

in 

We analyze M5-instantons in F-theory, or equivalently D3-instantons with varying 
axio-dilaton, in the presence of 7-brane gauge groups. The chiral two-form on the M5- 
brane plays an important role, because it couples the Mb brane to vector multiplets 
and charged chiral fields. The chiral two-form does not have a semi-classical description. 
However if the worldvolume of the M5 admits a fibration over a curve with surface fibers, 
then we can reduce the worldvolume theory to an 'MSW CFT by shrinking the surface. 
For this class of MSW instantons, we can use heterotic methods to do computations. 
We explain this in some detail using the physical gauge approach. We further compare 
M5-instantons with D3-instantons in perturbative type lib and find some striking differ- 
ences. In particular, we show that instanton zero modes tend to disappear and constraints 
from chirality on instanton contributions to the superpotential evaporate for finite string 
coupling. 
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1. The Mb instanton in F-theory 

The superpotential in an F-theory compactification is independent of the Kahler mod- 
uli, to all orders in large volume perturbation theory. However, dependence on the Kahler 
moduli may arise non-perturbatively. As the leading corrections to the superpotential, 
instanton corrections are important for a number of issues in phenomenological models. 
For instance we may use them for generating scales, like the scale of supersymmetry 
breaking, or for lifting flat directions. In F-theory models, the natural objects generating 
such corrections are F3-instantons, as they remain F3-instantons under £7(2, Z) trans- 
formations. Other instantons, such as worldsheet/Fl-instantons of perturbative type lib, 
are normally absent in F-theory due to Sl(2, Z) monodromies. 

F-theory vacua are essentially supergravity backgrounds. Rules for computing correc- 
tions due to Euclidean solitons in supergravity have been proposed by [1, 2, 3]. The basic 
idea is to compute a correlator of vertex operators in the twisted worldvolume theory 
of the instanton. Since the worldvolume theory of a F3-brane is the maximally super- 
symmetric Yang-Mills theory, naively this means we should compute correlators in this 
Yang-Mills theory, or perhaps some twisted version thereof. 

However it is not really correct to conclude that S7(2, Z) monodromies do not affect the 
worldvolume theory. The coupling constant of the Yang-Mills theory is the axio-dilaton, 
which varies from point to point over the worldvolume and is usually multi- valued, because 
the discriminant locus typically intersects the worldvolume. This means that generically 
the worldvolume theory cannot be discussed in terms of a weakly coupled Yang-Mills 
theory with only electric degrees of freedom, as circling around a branch cut turns electric 
into magnetic degrees of freedom. 

As always in F-theory, the way to deal with the branch cuts is to switch to different 
variables [4]. The clearest way to define an F-theory vacuum is by taking a limit of an 
M-theory vacuum on an elliptically fibered Calabi-Yau four-fold with G 4 -flux. Essentially 
this entails a change of variable from the axio-dilaton to the coefficients of the Weierstrass 
equation, which are defined globally without branch cuts. The D3 instanton with varying 
coupling constant in F-theory lifts to an Mb instanton in M-theory, wrapping the elliptic 
fiber. Therefore a computation on a F3-brane with varying axio-dilaton can be reformu- 
lated as a computation in the Mb worldvolume theory. The M5-brane theory describes 
both electric and magnetic degrees of freedom, and is not weakly coupled. 

The Mb worldvolume theory is the six- dimensional (0, 2)-theory, with five scalars, a 
self-dual two-form, and sixteen superpartner fermions. Unlike a F3-brane in perturbative 
lib, it is a chiral theory. It must have somewhat exotic properties, as expected from the 
above observations, and this complicates the computations. The fermions and scalars are 
relatively straightforward. The fermion kinetic terms on the Mb are schematically of the 



form 

<fxe(p+@)$ (1.1; 



'Mb 

As we will briefly review later, the analysis of fermion zero modes is straightforward in the 
absence of G-flux, and has been addressed even in backgrounds with G-flux. Although 
global G-fluxes are hard to work with, one can easily find examples where they don't 
affect the fermionic zero modes. The (twisted) scalars are also manageable. 

Unfortunately the chiral two-form is a whole other story. This field acts as the book- 
keeping device that allows us to keep track of the electric and magnetic gauge fields on 
the F>3-brane together with the monodromies, but it does not admit a conventional La- 
grangian description. Its partition function can be related to a theta function through 
holomorphic factorization [5] . However expressing this explicitly in terms of the compact- 
ification data is not straightforward, and involves transcendental methods rather than 
algebraic ones. In general it also appears to suffer from a holomorphic anomaly. 

One may consider taking a Sen limit [6] and comparing with perturbative lib, where 
issues are understood more clearly. In this limit, the string scale is parametrically small 
compared to the 10c? Planck scale, and one could hope to use the method of Ganor strings 
[7]. However the limit is not necessarily smooth or may not even exist [8]. Moreover, 
F-theory has fewer symmetries, and so one suspects that many more instantons should 
contribute in F-theory to a given amplitude. But in the lib limit one frequently seems 
to find too many zero modes and the amplitude vanishes. This indicates that we perhaps 
missed some effects by looking at instantons from a g s = perspective. One would prefer 
to learn to compute directly at finite string coupling, without reference to a lib limit. 

On the other hand, without the chiral two-form we are clearly missing a crucial part 
of the story. In F-theory models with non-trivial gauge groups, charged matter fields 
are certain simultaneous fluctuations of the three-form field G3 and the metric. The 
M5-instanton couples to these modes through the chiral two- form. In the lib limit, this 
yields the 37-strings which couple charged chiral fields to the F>3-instanton. So for various 
phenomenological applications, where we are interested in the coupling to charged chiral 
fields, it is crucial to incorporate the chiral two-form. 

In order to make progress, we are going to make a simplifying assumption. A general 
M5-brane in F-theory only admits an elliptic fibration. We will consider situations where 
the worldvolume of the M5-brane also admits a surface fibration over a complex curve Q: 

S ->• M5 

I (1.2) 

Q 

An instanton correction relevant for superpotential terms is of the form 

AW ~ /($)e" T (1.3) 



where T is a Kahler modulus and $ denotes complex structure moduli. Because the 
prefactor /($) does not depend on the Kahler moduli, we may do the computations in 
the limit that S shrinks to zero. In this limit, the M5 collapses to a string, and the 
worldvolume theory of the M 5 reduces to an effective "MSW" CFT [9] on Q. The chiral 
two-form reduces to chiral right- or left-moving scalars, which may be fermionized. The 
partition function is identified with a section of a determinant line bundle, and its zeroes 
can be understood as certain Dolbeault cohomology groups. Therefore in this class of 
examples we can be pretty explicit, while still retaining the essential features of M5- 
instantons, like a varying axio-dilaton with branch cuts on the worldvolume. 

This reasoning applies for instance to F-theory models with a heterotic dual, where 
the M5 wraps a F3-surface and the MSW CFT is simply the worldvolume theory of the 
heterotic string, and global G-fluxes are also fairly well understood. The F3-instantons 
can then be described as worldsheet instantons of the MSW CFT. 

Having mapped the problem to a heterotic-like set-up, one could now try to apply 
heterotic techniques to compute instanton correlators. ^From the F-theory perspective it 
is natural to try and apply the rules of [1] et al to compute instanton correlators, instead 
of using the old worldsheet techniques. The MSW string is generally not fundamental 
and so the old worldsheet methods should not be necessary. In fact such an approach was 
already proposed by Witten [3] quite a while ago. We will elaborate on this idea and see 
how it can be used to compute instanton correlators of charged fields. 

We also compare the M5 results with F3-instantons in the lib limit, in some special 
cases where the limit exists. We find that the zero mode structure for finite string coupling 
differs from the lib weak coupling limit. The main reason this happens is that there are 
extra U(l) gauge symmetries in type lib that are broken non-perturbatively. As a result 
there are fewer selection rules for finite string coupling. For instance we find that an 
apparent conflict between chiral matter and instanton contributions to the superpotential 
in type lib evaporates in F-theory. This has interesting consequences for model building 
[10, 11, 12]. Along the way we include a discussion of reducible brane configurations, 
which applies more broadly than the context encountered here. 

A number of results on F3-instantons in type lib and T-dual set-ups have appeared 
in recent years. See [13] for an extensive review of the literature on D-instantons in 
perturbative type II theories, and [14] for configurations close to those discussed here. 
Our discussion is meant to address the interaction of F3-instantons with mutually non- 
local 7-branes. 

Our 'heterotic' approach to M5-instantons and a number of our results were announced 
at the workshop "GUTS and Strings" in Munich [15]. Several related works appeared 
during the course of this work, see [16, 17] and [18]. 



2. Instantons in the heterotic string 

2.1. Green-Schwarz approach 

In the Green-Schwarz formalism, the worldsheet instanton amplitudes look quite sim- 
ilar to those of .D-instantons, so one may try to use .D-instanton inspired techniques to 
calculate worldsheet instanton effects. In [3] this is called the physical gauge or Green- 
Schwarz approach. 

Consider a curve Q in the heterotic Calabi-Yau Z with bundle V. The physical degrees 
of freedom living on Q are as follows. The left-movers form an 5*0(32) or E$ x E$ current 
algebra. We will use the fermionic formulation. Then the left-moving fermions live in 

A G r(Q,V(-l)| Q ) (2.1) 

The structure group of V is the manifest symmetry group that is visible in the fermionic 
formulation. For the 5*0(32) heterotic string, V is an 50(32) bundle. For the Eg x E$ 
heterotic string, which is the case we will be interested in here, V denotes an 50(16) x 
50(16) bundle. The fermions satisfy a Majorana condition in Minkowki signature, but 
we have to complexify them when we work in Euclidean signature. 

For the right-movers, we use GS variables (X, G) and restrict to physical gauge, fixing 
world-sheet reparametrizations by setting the longitudinal coordinates X^(z) = z and 
using kappa symmetry to set P + Q = 0. Then the remaining right-moving bosons live in 

X 1 - G T{Q,0®O®N) (2.2) 

and the right-moving fermions, collectively called O -1 , live in 

Xt e T(Q,N\ Q )®S- 
9 a G r(Q,(5 Q )®5 + = C 2 
0? G r(Q,ti 1 Q )®S + (2.3) 

We have adopted the notation of [19], where the bar indicates right-moving fields which 
we take to be anti-holomorphic. The zero modes are given by the global holomorphic 
sections for the left-movers, or the global anti-holomorphic sections for the right-movers. 
At the least we have four bosonic zero modes, for the four translation symmetries broken 
by the instanton, and two right-moving fermionic zero modes. 

The fermion bilinears in the 4d supergravity action are given by [20] 

e K/2 [Wij-fij + DtWx'lii + D % D 3 Wx % X J \ (2.4) 



The contribution of an instanton wrapped on Q to the superpotential can be obtained by 
computing a correction to the (xx) correlator. The end result is surprisingly simple; the 
contribution to the superpotential is simply given by the world-volume partition function, 
obtained by integrating out all the physical degrees of freedom on Q: 

Z[A, g,B]= f dX 1 - dB 1 - d\ 6 ~ Sq[a ^ b] (2.5) 



It is convenient to factor out the universal zero modes: 



AS M = fd 4 xd 2 9AW, AW = ( dXded\e- SQ[A ' 9 ' B] 



(2.6) 



We get a non-zero contribution only when Q is a rational curve. Higher genus curves 
would carry additional 0f zero modes, and integrating over them leads to multi-fermion 
F-terms but not superpotential contributions. 

Let us further assume that our instanton is isolated, i.e. it has only the universal zero 
modes and no more. As usual in supersymmetric theories, we only need to evaluate the 
classical action and the one-loop determinant around the classical solution: 

AW = . V F> e~ Tg 2.7 

y/fet'(D B ) 

Here we defined the Kahler modulus as 

Tq = f J-i f B (2.8) 



The Pfafnan in (2.7) arises because we complexified the fermions in Euclidean space, so we 
must take a square root to factor out the extra contributions. A prime denotes omission of 
zero modes. Specializing this to our isolated instanton, we get the following contribution 
to the space-time superpotential [3]: 

aw _mdv(-D) _ e - TQ (29) 

(det<9e>(_i)) (det'do) 

Here V is assumed to be an 5*0(32) bundle. For E 8 x E 8 , the natural guess is to replace the 
determinant of 9y(-i) by the partition function of level one E 8 x E 8 Kac-Moody algebra. 
The partition function depends on a choice of (perturbative) vacuum, i.e. a choice of 
background metric, 5-field and gauge field. 



2.2. Calculating the Pfaffian 

The denominator in (2.9) can be computed easily but does not depend on massless 
chiral fields. Let us therefore focus on the partition function of the left-movers, the 
Pfaffian, which does depend on them. As a partition function of fermions, the Pfaffian 
suffers from an anomaly: 

Z^A + dX] = e^^ XF Z^[A] (2.10) 

where n is the number of species. Therefore the value of the Pfaffian at a given point 
on the moduli space does not make sense. The Pfaffian is not a function, but rather a 
section of a certain line bundle over the moduli space. 

Nevertheless, there is invariant information in the Pfaffian. Although the value of a 
section of a line bundle is not well-defined, the zero locus of this section is well-defined, in 
fact it determines the section up to rescaling. Therefore one can still compute the moduli 
dependence of the superpotential up to an overall scalar. This strategy was successfully 
carried out in several examples by [21] and further in [22]. 

Let us consider the zero locus of the Pfaffian. It vanishes when the moduli are such 
that <9y(_i) develops zero modes, i.e. when H°(Q,V(—1)\q) is non-trivial. Any bundle on 
P 1 decomposes as a sum of line bundles, so we may write 

V\ Q = Q)0(a l )®0(-a l ) (2.11) 

i 

(The a,i come in ± pairs since our V is assumed to be orthogonal.) Using the well-known 
formula for the Dolbeault cohomology of line bundles on P 1 , we find that 

H°(Q,V(-1)| Q ) = £>| (2.12) 

Hence left-moving zero modes are absent if and only if all Oj vanish, i.e. V\q is a trivial 
bundle [23]. This argument also applies to E 8 x E 8 bundles, as long as the holonomy is 
contained in SO (16) x SO(lQ). 

We assume that Z is elliptically fibered with section <7b 2 , and V is constructed through 
a spectral cover (C,L). We consider only rational curves that are contained in the zero 
section <jb 2 - For these we have 

V\ Q = ttcMq, V(-1)\ q = n c M-F)\ Q (2.13) 

where F is the class of the elliptic fiber inside the surface 7r^ 1 (Q). (One complication 
that arises for more general rational curves Q that are not necessarily contained in a# 2 
is that the direct image above has to be replaced by a Fourier- Mukai transform. A more 
significant issue is that quite often rigid curves Q that are contained in <jb 2 are the unique 
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effective representatives, in the threefold Z, of their cohomology class, while more general 
rigid curves Q that are not contained in <7b 2 often come in large collections that all 
represent the same cohomology class in Z.) In our case, let us define the spectral curve 
£ 37 to be given by 

Z 37 = n z 1 (Q)nC (2.14) 

We will explain the reason for this notation in section 4. By applying the direct image, 
we find that 

H°(Q,V(-l)\ Q ) = tf (E 37 ,L(-F)| E37 ), 
H°(Q,V*(-1)\ Q ) = H^Li-F)^)* (2.15) 

Note that since Ci(V) = 0, from the Riemann-Roch formula on Q it follows that the ranks 
of these two Dolbeault cohomology groups must be equal, so fermion zero modes always 
come in pairs. From Riemann-Roch on S37 we see that L(—F) is a line bundle of degree 
g — 1, where g is the genus of E37. The vanishing locus of the Pfaffian corresponds to the 
locus where the Dolbeault cohomology groups on S 37 valued in the line bundle L(— F)|s 37 
are non-zero. 

The fact that L has vanishing holomorphic Euler characteristic (i.e. degree g — 1), 
rather than vanishing degree, is crucial also for the interpretation of the Pfaffian via theta 
functions. In our set-up varying the bundle V results in variation of the complex structure 
of S37 as well as the induced line bundle on it. The line bundle L on C typically has no 
moduli, but by varying the spectral cover, the restriction of L to X37 may vary. Hence we 
are dealing with a map 

M(C,L)-M, (2.16) 

from the space Ai(C,L) parametrizing the pairs C, L to a "universal Picard variety" U 
which fibers over the moduli space Ai g of genus g Riemann surfaces, the fiber over C 
being the torus Pic 9_1 (C) parametrizing all complex line bundles of degree g — 1 on C . 
When we thus allow r (or equivalently, the period matrix) to vary, it becomes important 
that the Pfaffian really computes 9/r], with the I/77 being the contribution of the massive 
modes. Here becomes a function of z and r, while 77 is a function of r alone. The 
vanishing locus of the Pfaffian corresponds to the inverse image of the theta divisor, and 
77 becomes part of the undetermined scaling. 

The algebraic approach is based on determinant line bundles, following Grothendieck- 
Knudsen-Mumford and Deligne. It is known to be equivalent [25] to the transcendental 
approach outlined above, but is often much more amenable to explicit calculations. The 
algebraic description of the Pfaffian also makes it clear that we get a polynomial on 
M(C,L). 

In fact we can use the algebraic description to calculate the moduli dependence of the 
Pfaffian directly. Suppose we have a family of Riemann surfaces parametrized by s G S. 
In the algebraic description the determinant line bundle over S is defined as 

&et = det(iJ°(S s ,L s ))det(/J 1 (S s ,L s ))- 1 (2.17) 



Now suppose that we can establish an exact sequence of the form 

->• H°(Z S ,L S ) ->■ W 1 4 W 2 -)■ H\J: S ,L S ) -»■ (2.18) 

or some variation thereof. Then by general properties of determinant lines, we get an 
isomorphism 

0et = det(W^i)~ 1 det(W / " 2 )) (2.19) 

and a canonical section det /. Since the algebraic and analytic approaches agree, we may 
take 

Pf = det 9 = det/ (2.20) 

The authors of [21] arrive at the following exact sequence 

-»■ #°(E 37 , L(-F)) -»■ Wi A W 2 ->■ /J 1 (S 37 ,L(-F)) ->■ (2.21) 

with 

^^^(^-^^(-F-Est)), W^ 2 = i/ 1 (7r- 1 Q,L(-F)) (2.22) 

Here / is multiplication by the section which vanishes at E 37 , i.e. the equation of E 37 in 
7r _1 Q, and the last map is restriction to E 37 . Calculating / by pushing down to Q, one 
finds explicit formulae for the Pfaffian as a function of the moduli [21]. 

Let us try to restate this in a more physical and less mathematical manner. We will go 
through this because we get very similar objects as in the M5-brane story, but in a more 
familiar setting. We have some left-moving fermions on Q, coupled to a gauge bundle, 
and we want to compute their partition function (or at least the moduli dependence). 
Since V\x B = nc*L, we can locally think of V as n copies of L, where n is the degree of 
the spectral cover, but then the n fermions coupled to each copy will have branch cuts. 
We can eliminate the branch cuts by thinking of the n fermions as a single fermion living 
on a n-fold cover of Q, which is what we have called E 37 , and coupled to L. Therefore we 
want to compute the partition function of a chiral fermion on E 37 coupled to L: 

Z^A] oc /"#e^37 d2 V3^ (2>23) 

as well as a second fermion on E 37 , obtained by lifting the fermion on Q that is coupled 
to V*. The line bundle should be flat in order for the partition function to make sense. 
In the fermionic description this arises because if the line bundle is not flat, then there 
are always chiral fermion zero modes which can only be absorbed by extra insertions in 
the path integral. In the bosonized description, this arises because the interaction term 
may be rewritten as 

d 2 zd z (j)A s = - d 2 z(f)F zS (2.24) 

10 



which implies that there is a tadpole for the chiral boson. The line bundle L(—F) that 

~ 1/2 

we found above actually has degree g — 1, but we should morally think of it as L <g> K-% 
where L is flat. 

Partition functions of chiral fermions on a Riemann surface are well-known objects, 
and we could take several points of view. Our interest here is in the fact that up to a 
non-vanishing factor, they are given by theta-functions with characteristics: 

Z^ oc Q§](t\v) (2.25) 

For instance, on a genus one Riemann surface we have the well-known expressions 

Z^ = g -V24+£a 3 e ari a /? Jj (1 + Jiifi q m-\+a ^Q + ^2^-i-c^-l) = gglW (2>26) 

with g = exp(27rir) and z = exp(27riz/). This generalizes to higher genus Riemann surfaces 
and also to M5-branes. Let us review some aspects of the theory of theta-functions. 

We fix a basis {A it B^} of one-cycles on E 37 , with the following intersection properties: 
A i f]A j = BiCiBj = 0, A'nBj = 5) (2.27) 

Let us also fix a basis w J of holomorphic one-forms with the property 

Uj = 5) (2.28) 

J A 1 

The period matrix is defined as 

nj = [ to, (2.29) 

Jb x 

Now let us fix a base point po on E37. Then we get a multi- valued map from E to C 9 by 

p -> / Wj (2.30) 

To get a single valued map on E, we have to make the identifications 

£ ~ x + (a + b-r), a,b e Z g (2.31) 

The periodic identifications by the lattice A = Z 9 + Z s r make C 9 into a torus, which is 
called the Jacobian of E: 

J{T) = C 9 /A (2.32) 

11 



Said differently, a closed one-form AonE defines a point on i? 1 (E, R)/iJ 1 (S, Z) ~ T 2fl . 
The Hodge *-operator satisfies * 2 = — f, so it defines a complex structure on H 1 : 

*A l >° = +iA 1 >° : *A ^ = -iA G > 1 (2.33) 

The induced a complex structure on T 2g gives us J7"(S). 

The Jacobian naturally comes with several additional structures. Given a metric on 
X, we get a translationally invariant metric on J7"(S) given by 



gj(A,A) = J AA*A (2.34) 

The associated Kahler form 

u(A,A') = f AAA' (2.35) 

defines a 'principle polarization' on J7", i.e. it is a symplectic form in H 2 (J ', Z) such that 
J7"(S) has volume equal to one. 

Any holomorphic line bundle on S37 is determined by the flux (i.e. its first Chern 
class), and by the Wilson lines, i.e. the periods of a holomorphic connection. Let us 
assume that the flux vanishes, so that the fermion partition function is defined. Then 
the connection is a closed form, and the Wilson lines determine a unique point on the 
Jacobian; the identifications by A are due to the large gauge transformations. So we 
may think of the Jacobian as the moduli space of flat connections on S 37 . Therefore the 
partition function naturally 'lives' on J7"(S). 

Now recall that the partition function of a chiral fermion on £37 is not a function on 
the Jacobian but a section of a line bundle C. The curvature of this line bundle is in fact 
2ttu. From the index theorem on J7"(S) and positivity of u, it follows that L has exactly 
one section, which we want to identify with Z^. But to fix C we also need to specify the 
holonomies. 

To do this we first consider the moduli space of degree g — 1 line bundles. Here we 

have a canonical section, namely the Riemann theta function. Its zero set, called the 

theta-divisor, corresponds to degree g — 1 line bundles with a section. Its translates 

by a spin structure yields the theta-f unctions with characteristics. They have the right 

vanishing behaviour [24]. Since for each spin structure we had a line bundle with a unique 

section, the partition function is uniquely determined to be proportional to the associated 

theta-function with characteristics on the Jacobian. 

~ 1/2 

In our case actually we are not given Lji at and K^ separately, but rather the tensor 

~ 1/9 

product Lfi a t <S> Kj/ = L{—F) which is defined unambiguously. Since L(—F) has degree 
g — 1, as discussed above there is actually a unique choice of theta-function, the Riemann 
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theta-function, which we interpret as the partition function of our fermions. The theta- 
function vanishes along a divisor on J7"(S 37 ), the theta-divisor, which corresponds to the 
locus where the line bundle L(— -F)|s 37 has a section, i.e. where we get fermion zero modes. 

2.3. Coupling to supergravity 

Although the partition function for chiral fermions suffered from a gauge anomaly, the 
combined partition function, including all the worldsheet fields and using a proper defini- 
tion of the -B-field, must be anomaly free. So it seems that modulo possible i?-anomalies, 
the superpotential should be an ordinary function on the moduli space. However when we 
couple to supergravity, in order for the action to be even classically invariant under Kahler 
transformations, we also need accompany the Kahler transformations with a certain local 
U{1)r transformation. As a result of this, when Mp\ is finite, the superpotential is still 
a section of a non-trivial line bundle over the moduli space. Let us briefly sketch some 
of the structure of N = 1 supergravity Lagrangians that lead to this conclusion (see eg. 
[26]). 

We can couple the globally supersymmetric Lagrangian for the matter fields to the 
linearized supergravity multiplet through the Noether currents with coupling \jMp\. This 
action is invariant under local supersymmetry up to terms of order \jMp\. We then add 
further terms to the Lagrangian and supersymmetry variations so that supersymmetry is 
preserved to this order, and so on. One ends up with a Lagrangian in which the fermion 
kinetic terms contain the following covariant derivative: 

A = V, + \q k 2 d t K, ^ = ^pt ( 2 - 36 ) 

Here V is the ordinary covariant derivative including Kahler Christoffel symbols for the 
non-trivial metric on the sigma model, and q is — 1 for chiral fermions and +1 for gauginos 
and the gravitino. 

Now under a Kahler transformation, we have 

K 2 K(z,z)^K 2 K(z,z) + f(z) + f*(z), qK 2 diK ^ qK 2 diK + qdj (2.37) 

In other words, although the Lagrangian is invariant under local supersymmetry vari- 
ation, it is not invariant under local Kahler transformations. So in order to make the 
Lagrangian well-defined, we have to cancel the Kahler variation of the covariant deriva- 
tive by accompanying it with a chiral U(1)r rotation on the fermions. 

As a result, the superpotential, which has i?-charge two under such a rotation, is 
not a function on the moduli space, but rather a section of a line bundle Ck on the 
moduli space, the line bundle being defined by the transformation properties under Kahler 
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transformations above. The curvature of this line bundle is given by the Kahler form [27] 

ci(C K ) = ^-ddK/M 2 Pl (2.38) 

Moreover, this class should be quantized. 

2.4- Instanton correlators 

Suppose now instead we want to compute corrections to specific correlators. To do 
this, we go back to the partition function (2.5). It depends on a choice of vacuum, which 
involves a choice of background A on Z. Let us consider the partition function as a 
functional of the background field A: 

Z[A] = I dX ± de ± d\e~ s[A] (2.39) 

In light-cone gauge, the couplings of the world-sheet fields to the background gauge field 
and gaugino are given by 

I = Jd 2 zTr(A z J z ) + i(er 2 -r m "0)Tr(F mS J 2 ) + h s Tr(fj z ) (2.40) 

Here a refers to ten-dimensional spinor indices, and j% ~ B z Xm^ m Qq. is the supersymme- 
try current in light-cone gauge. We will be interested mainly in isolated rational curves, 
in which case the four-Fermi term vanishes. 

The zero modes 5 A are tangent vectors to the space of gauge fields modulo gauge trans- 
formations at the chosen base point. Since the unbroken supersymmetry generators relate 
bosonic and fermionic wave-functions, we may collect them in Ad N = 1 supermultiplets: 

$A Z = (<j> + V2e a Xa )8A s (2.41) 

Thus the coupling of the worldsheet fields to the zero modes of (A, £) may be written as 

I -»■ J d 2 zTr(5A- z J z ) (2.42) 

By differentiating, we then find the correlation functions: 

D l ...D n W = I dXdQd\I 1 ...I n e- s[A] (2.43) 

14 



By W in this section we really mean AW, the contribution to the superpotential due to 
a worldsheet instanton wrapped on Q. The derivatives appearing in the above expression 
are the covariant derivatives, so unfortunately we cannot directly interpret this ampli- 
tude as computing a coupling in the superpotential. 1 In general one expects that if the 
superpotential coupling is not forbidden due to too many fermion zero modes, it will be 
non-zero. For instance if there are no left-moving zero modes on the instanton, then the 
instanton generically contributes to all possible couplings in the superpotential. 

But there is also a way to check whether a given term is non-zero and we are not 
missing any hidden cancellations. Namely we can try to tune the bundle moduli so that 
we get extra left-moving fermionic zero modes. For instance suppose we can tune the 
bundle moduli to get two left-moving fermionic zero modes. For those values of the 
moduli, the instanton then does not generate a contribution to W, and 

DiW = diW + K 2 diKW = diW (2.44) 

so the n — 1 case of (2.43) can be interpreted as directly computing a superpotential term. 
By holomorphy, if this superpotential term is non- vanishing, then it remains non- vanishing 
after a generic deformation. Similarly if (W) = (d)-W) = then 

{D 2 D X W) = (d 2 D 1 W + K 2 d 2 KD 1 W + r* 1 D k W) = (^W) (2.45) 

and the instanton correlator directly computes a term in the superpotential. Again by 
holomorphy we conclude that if it does not vanish for those special values of the moduli 
where we get extra instanton zero modes, then it cannot vanish for generic bundle moduli 
either. 

A second situation where we can apply (2.43) is when there are 'chiral' fermion zero 
modes on the instanton. All our fermions were chiral anyways, but if V is an SU(n) 
bundle then some left-movers are coupled to V and others to V*, so we can ask for the 
net number of left-moving fermions valued in V minus the number of left-moving fermions 
valued in V*. Equivalently, we can ask for the net charge violation of the left-moving U(l) 
symmetry. As we already observed, this is governed by an index and vanishes when £ 37 
is irreducible, so there is no net number of chiral fermions in the above sense. However 
it may happen that S 37 is reducible, with an equal and opposite number of 'chiral' zero 
modes on each irreducible piece. This can happen for example if the vacuum admits an 
unbroken space-time U(l) symmetry and a gauged shift symmetry. In such a situation, 
again some of the lower-point correlators are guaranteed to vanish, effectively turning 
some of the covariant derivatives in (2.43) into ordinary derivatives. We'll discuss an 
example of this type in section 2.7. 



lr rhis issue was essentially previously encountered in [28]: because two-point functions were non- 
vanishing there, one could not get a clean computation of the three-point functions. Here also if one 
proceeds to calculate higher point functions anyways, one finds the correlator is not well-defined on 
Dolbeault cohomology classes and contact terms are needed. 
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2.5. Couplings in E 6 models 

We would like to use (2.43) to check for instanton corrections to specific superpotential 
couplings. As a first example, let us consider heterotic models with with an SU(3) bundle, 
which yields E$ GUT models in four dimensions. We decompose the adjoint according to 

248 = (1,78) + (3, 27) + (3, 27) + (8,1) (2.46) 

Chiral fields live in H 1 (Z , &dj(E 8 )) . Using the above decomposition, one finds that the 
charged chiral fields are counted by 

H X (Z,V)® 27, H\Z,K 2 V)®Tr (2.47) 

Let us see what kind of couplings we can compute. 

We use the fermionic formulation of the E% x E% theory. In this formulation, the 32 
left-moving fermions transform are split into two sets, each only transforming manifestly 
under an 5*0(16) C E 8 . Only bundles with holonomy contained in 50(16) x 50(16) can 
be described in these variables. Embedding the 577(3) holonomy group in 50(16), the 
16 of 50(16) splits as 

16 = (3, 1)_! + (3, 1) +1 + (1, 10) (2.48) 

of SU(3) x 50(10) x U(l). We will label the fermion indices as i,i,a accordingly. In a 
(2,2) model, the U(l) may be identified with the left-moving U(1)r symmetry. 

Under 50(10) x U{\) C E 6 , the 27 decomposes as 

27 = 10_i + 16i /2 + 1 2 (2.49) 

The vertex operators are of the form 

w (z)j A J 1 = 5A- Z j(z)dz A J 1 (2.50) 

For the 27 states in the NS sector they are given by 

U10 = w^{z)dzX\ a , V 1 = w^{z)dzg*e ]M \ l \ l (2.51) 

Let us also write the vertex operators for the bundle moduli, which are of the form 

V m = w(z)- zJ dzT^X l X ] (2.52) 
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We first consider generic £77(3) bundles. Generically the restriction of the bundle to 
Q is balanced, i.e. 

V\ Q = O(0) + O(0) + O(0) (2.53) 

Recall that the left-moving instanton zero modes are counted by 

H°(Q,V(-1)| Q ) (2.54) 

where V is the rank 16 vector bundle transforming as (2.48). Therefore in this case there 
are no left-moving zero modes. As we already saw previously in section 2.2, this im- 
plies that the instanton generically contributes to the zero-point function (the partition 
function). Therefore barring unexpected cancellations, which would be hard to see and 
non-generic, the instanton will contribute to all the couplings appearing in the superpo- 
tential, but it would be hard to compute them directly using (2.43) due to appearance 
of covariant derivatives rather than ordinary derivatives. Let us now assume that we can 
tune the moduli to get extra left-moving zero modes. 

The next interesting case is 

V\ Q = 0(1) + O(-l) + O(0) (2.55) 

In this case we can reliably compute the one-point function. There are two left-moving 
fermion zero modes, one for A 1 and one for A 2 . The wave functions for both of these zero 
modes are constant on Q. Vertex operators for vector bundle moduli X can absorb the 
zero modes if they are of the following form when restricted to Q: 

V x = w^ z dz\ x \ 2 (2.56) 

This signifies the presence of a tadpole non-perturbatively: 

d x W = fdXdQd\V x e- s ~ ( f w x je~ TQ (2.57) 

On the right we left out the one-loop determinants, which are non-zero generically. If 
these tadpoles are non-vanishing, then computations of non-perturbative corrections to 
higher order terms in the superpotential can not be done cleanly in this perturbative 
vacuum. 

By a further tuning, we can get a splitting type of the form 

V\ Q = 0(2) + O(-l) + O(-l) (2.58) 

This happens at complex codimension four in moduli space. In this case there are four 
left-moving zero modes. An example of this is the standard embedding, for which we 
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have V = TZ. But in the standard embedding we get the same splitting type above on 
any generic isolated curve. For a more generic SU(3) bundle satisfying (2.58), we would 
typically get this splitting type only on Q. 

Zero and one-point functions are vanishing, and we can unambiguously compute a 
two-point function with two vector bundle moduli (in other words, non-perturbative mass 
terms for vector bundle moduli). But a small surprise happens: the 27 3 Yukawa couplings 
are unpolluted by these non-vanishing two-point functions, so we can also compute them. 
The reason for this is as follows. Let us denote fields in the 27 by $ and neutral fields by 
X. We look at the correlator 

D%W = 8%W + k 2 8%K ds,W + ... + T^d^d x W (2.59) 

The expansion in Christoffel symbols is quite messy, but the point is that all these terms 
vanish if (W) = (dxW) = 0. Terms like (d$W) vanish automatically. As a result, 

(D%W) = {d%W) (2.60) 

and so the 27 3 Yukawa couplings can be computed even with only four left-moving zero 
modes. We will do this computation next. Note that this simplification does not hold for 
all Yukawa couplings however. For the 27-27-1 Yukawa couplings we do have to take 
account of the non- vanishing two-point functions, as was previously found in [28] . 

To make things slightly more transparent, let us use homogeneous coordinates cr^, 
C, = 1, 2 on Q. We find the following left-moving instanton zero modes, 



A 1 


= a^a^ 


A 5 


= 


A 3 


= 7 



(2.61) 
Recall that under SO (10) x U(l) C E 6 , the 27 decomposes as 

27 = 10_i + 16 1/2 + 1 2 (2.62) 

so to get the 27 3 we can try to compute the 16 • 16 • 10 or the 10-10-1 coupling. Both 
must give the same answer due to the underlying E 6 symmetry. Let us first consider the 
10-10-1 coupling. 

There are no bosonic zero modes or right-moving fermionic zero modes other than the 
universal ones, so the zero mode measure is simply given by 

dM = d 2 ad(3d-i (2.63) 



Actually the true fermion measure also depends on the Pfaffian of the non-zero modes, 
but again for our purpose this is not too important. We have 

d<?i = e a ^afda^ = (a i: doj) , d 2 a = da A da (2.64) 

Using the vertex operators given above, we get 

d 1 d 2 d 3 W oc dM]\<Pa i (v}i\a 1 )V$(<r 2 )v} 3 \<T 3 ) 
•* i=i 

3 



oc I dM f\w {i) (a i )d 2 a i (a ■ a x )(a ■ a 2 ) - l B^ 
J fj; {<7i,<t 2 ) 



i=l 
3 



n , \ai,a 2 ) 
w{ai)d Oi -. r 

, ..-, (0-1,0-2) 

(1) \ I I ,„(2) \ I I ,„(3) 



I \ / I \ / I (2 " 65) 

Here the propagator came from the non-zero modes (\ a (ai)\ b (a 2 )} = Tr(T a T 6 )/ (ax, a 2 ), 
and the fermionic integral yielded J d 2 a (a • ai)(a • a 2 ) = (<Ti,a 2 ). 

Similarly we may try to compute the 16 • 16 • 10 coupling. The vertex operators for 
the 16 create a branch cut for the A's. We can eliminate the branch cut by computing 
on the cylinder; equivalently we can work in a twisted version of the theory. Let us first 
discuss some aspects of the R sector states appearing in the 248 of E$; then by breaking 
this down to various subgroups, we can get all others as special cases. 

Under 50(16), the 248 of E 8 splits as 

248 = 120 + 128 (2.66) 

where 128 is the positive chirality spinor of SO (16). To get the 248 3 , we compute the 
128 • 128 • 120 coupling, which has two R sector states and one NS sector state. Let 
us assume that the 5*0(16) bundle V has a Hermitian structure and can be split as 
V = W + W* . We consider the following left-moving current: 



J|°* = VAT (2.67) 



This corresponds to the 'diagonal' U(l) C .SO (16). Now the left-moving Ramond ground 
states form a Clifford algebra. The 'empty' state corresponds to the following vertex 
operator: 

exp(l [ J l L ot ) (2.68) 
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and the remaining states are found by acting on it with A*, subject to a GSO projection. 
Hence we will twist by ^Jl *. This maps the three-point function to a computation on the 
sphere with only NS sector states. The new NS vertex operators replacing the R sector 
vertex operators correspond to (0, 1) forms valued in A even W, and they naturally sit in 
the 128. 

After twisting, the left-moving fermions are sections of 

T(Q,W\ Q ), T(Q,W*®K Q \ Q ) (2.69) 

and the zero modes correspond to global holomorphic sections. From Riemann-Roch, 
we expect at least eight left-moving zero modes, so the calculation is going to be a bit 
different from the 10 • 10 • 1 coupling where we only had four zero modes. 

In order to apply this to the case at hand, we further split 

W = V + U (2.70) 

where V is our non-trivial SU(3) bundle, and U is the trivial rank five bundle. The 
fermions \\ i — 1, 2, 3 couple to V, and the fermions \ b ,b = 1, . . . , 5 couple to U . The 
vertex operators for the 10_i C 27 where listed in (2.50). They correspond to (0, 1) forms 
valued in V <g> (U + U*). After twisting, the vertex operators for the I61/2 C 27 are given 
by 

16 1/2 : wiz)^^ 

w(z) i \ i \^ b '^ (2.71) 

w(z) i X i X [blb2b3b4b5] 

Here we used the shorthand notation A' bl " 6fe ^ = \ bl ■ ■ ■ \ bk . Also, after spectral flow the 
U(l) charge shifts from I61/2 to 16_i. These vertex operators are made from (0, 1) forms 
valued in 

V ® (U + A 3 U + A 5 U) (2.72) 

Now when the bundle V has splitting type {2, — 1, —1} on Q, from (2.69) we find three 
zero modes for A 1 , and one zero mode for each X bj , j = 1, . . . , 5. Hence the correlator is 
simply 



3 
d^dsW oc I dM n^cri Vi e (<7i)yio(02)Vie(<T3) 



i=\ 

5 



j=\ i=l 

x I / W W) ( [ w^) ( [ w^) (2.73) 
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The dots in the second line denote the other terms one gets by writing out all the pieces 
of the vertex operators in the 16 in (2.71) and in the 10. To go from the second line to 
the third line, first we absorbed one A 1 zero mode with each of the three vertex operators, 
so that the w^ become (1,1) forms on Q. For the X bj correlators, the only terms that can 
be non-zero are the terms which have exactly one A fej for every j. This follows from the 
unbroken gauge symmetry, specifically the selection rules for the U(l) 5 C 5*0(10) C E 6 . 
Normally the correlator should be neutral under each unbroken U(l), but due to the 
twisting each U(l) has a background charge and so there is a shift by one. Finally then 
absorbing the five \J zero modes picks the singlet in the tensor product 16® 10® 16. (In 
terms of the decomposition above, this reduces to the familiar GUT group algebra which 
yields the singlets 10 • 10 ■ 5^ and 10 • 5 m • 5/J. So the correlator is ultimately completely 
determined by the zero modes, and we get the same answer as for the 10 • 10 ■ 1 coupling, 
as it had to be by the underlying E$ symmetry. 

We may also ask if we get a contribution to the 27 . The vertex operators are similar 
to those in (2.51) but the fermions are conjugated: 

Vi„ ~ w Stl (z)dz A ? A°, V 1 ~ w^(z)dzg lj e jkl X k X l (2.74) 

The fermion zero modes are still given by (2.61). We see that it is impossible to absorb 
the two A 1 zero modes. So the instanton contribution to the 27 vanishes. Non-vanishing 
instanton contributions can only come from instantons with at most two left-moving 
fermion zero modes. 

The calculations we have done here for the Yukawa couplings are slightly simplified 
versions of calculations originally done in (2,2) models in the world-sheet approach [29]. 
The coefficient of the Yukawa coupling counts the number of holomorphic maps from P 1 to 
Q where three marked points are mapped to -Djfl Q, with Di the Poincare dual of w^\ As 
we saw above, this gives the same number as the GS computation. The main differences 
in the computation are as follows: we do not integrate over the space of maps P 1 —¥ Z, 
only over the space of (super)embeddings; and since we fixed the gauge redundancy from 
the start, there are no (super)ghost correlators. As a result, the GS computation is a bit 
shorter. 

2.6. Couplings in SU(5) models 

By further breaking down Eq, we can generalize this to smaller gauge groups. We will 
briefly spell this out for SU(5)gut- I n the fermionic description, the manifest SO (16) is 
broken to SU(4) x U(l) by the 577(5) holonomy, and the 16 of 50(16) is broken as 

16 = (5,l) + i + (5,l)_i + (l,6)o (2.75) 

under SU(5) x 577(4) x U(l). Accordingly we split up the 16 indices as i = 1,...,5, 
i = 1, . . . , 5, a = 1, . . . , 6. Thus in this description, only a subgroup SU(A) x (7(1) C 
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SU(5)gut of the GUT group is manifest. We use the following decompositions of the 
matter representations under SU(4) x U(l): 

5 = 4 1/2 + l_ 2 , 10 = 4_ 3 /2 + 6 1 (2.76) 

Now let us think about the instanton zero modes. As usual they are counted by 

H°(Q,V(-±)\q) (2-77) 

where in the present case 

6 

V = l/®r®00 (2.78) 

a=l 

The fermions A a are sections of 0(—1)q and can never have any zero modes. Let us 
denote by V the £77(5) bundle which breaks E 8 to SU(5)gut- Then we can decompose 

5 

Vls~00(a,), J> = (2.79) 

i=l i 

Clearly we get essentially the same calculations as for the Eq models, as the zero mode 
structure is completely determined by the splitting type of the bundle on Q. For instance 
let us try to understand corrections to Yukawa couplings. To get a clean computation, 
we need to arrange for four left-moving zero modes, i.e. 

^ = {2,-1,-1,0,0} (2.80) 

Now we look at corrections to the 10-10-5 coupling, which can be computed in the NS 
sector from the 6i ■ 6i • 1 2- To find the vertex operators, we recall the usual decomposition 
of the adjoint representation of E$ under SU(5)h x SU(5)gut'- 

248 = (24, 1) + (1, 24) + (5, 10) + (5,10) + (10, 5) + (10, 5) (2.81) 

Therefore a state of the 5 matter representation comes from a generator of the Dolbeault 
cohomology group H 1 (Z,A 2 V*). Similarly a state in the 10 comes from a generator of 
H 1 (Z, V). Hence the vertex operators are of the following form: 

V 1 = w(z) s> ijdz \h ] , V 6 = w(z)z :i dz X\ a (2.82) 

Essentially the same calculation as for the 27 3 coupling above shows that we get a non- 
zero contribution of the form {J Q W ) 3 of the instanton to the Yukawa coupling, since we 
have just broken it into smaller pieces. We will not repeat it here. 
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Similarly we can try to compute the 10-5-5 coupling for splitting type {2, —1,-1, 0, 0}, 
for instance by evaluating the 6i-4_ 1 / 2 -4_ 1 / 2 . Again due to the branch cuts it is convenient 
to compute this in the twisted theory This is similar to the 16 ■ 16 ■ 10 couplings in Eq 
models. We again split V as V = W + W*, and W = V + U where V is our non-trivial 
SU(5) bundle, and U is a trivial rank three bundle. After twisting, vertex operators in 
the Ramond sector become (0, 1) forms valued in 

A even w = Q tfy ® tfU (2.83) 

p+q=even 

I.e. we have vertex operators of the form 

4-3/2 : w(z)sjdz\W 4_ 1/2 : w{z)- z ^dz\^ 

w(z)- Z:i dz\^ b ^ w(z)- Z:ij dz\^ b ^ [ } 

and their conjugates. Here we have slightly abused notation, indicating the U(l) charge 
before spectral flow. After spectral flow we have 4_ 3 / 2 — >■ 4i, 4_i/ 2 — >■ 4 2 . The calculation 
now proceeds as before and is completely determined by the zero modes structure: 

3 

8 3 W oc dM Y[d 2 a i V 4 (a 1 )V 6 (a 2 )V 4 (a 3 ) 

3 



/ JJ d 2 (Ti w- zM (a 1 )w^ z (a 2 )w z ^(a z ) 
•* i=i 



wAl w)( w 5 ) (2.85) 



2.7. Unbroken U '(1) s 

The examples we have considered are somewhat uninteresting, in the sense that the 
instanton generically has no left-moving zero modes, and thus it should contributes to all 
the gauge invariant couplings in the superpotential. The only really nice quantitity to 
compute in this case is the Pfafnan. An exception to this rule appears in vacua where 
extra left-moving zero modes are forced on us, such as vacua with an unbroken U(l) 
symmetry and a gauged shift symmetry. The U(l) symmetry does not necessarily need 
to be anomalous. We will review some of the story here and state the F-theory analogues 
in section 3. 

Let us assume that we have an unbroken U(l)x symmetry, and a chiral field X charged 
under it. If the symmetry is anomalous, then the Kahler moduli will shift under a U(l)x 
gauge transformation. The Kahler moduli and dilaton fields are defined as 

S = e - 2<t> V + ia, T Q = f J-i f B 2 (2.86) 

Jq Jq 

23 



Here V = vol(Z), a = J z Bq, <fi is the 10<i dilaton, and volumes are measured in string 
units. Under a U(l)x gauge transformation we have 

SS ~ ^^r?A x (2.87) 

where the trace runs over all the massless charged fields and Q x denotes the charge 
operator for U(l)x, and 

5T Q ~ i\ x J F x = 2mq x \ x (2.88) 



where we defined F x = Tr(T x Fe 8 )- We will mostly assume that Tr(Q x ) = 0, although 
it is not hard to make adjustments. If 5Tq ^ 0, the U(l)x will pick up a mass through 
the Stiickelberg mechanism: 

Sf D (q x A Xfl -d^m(T Q )) 2 (2.89) 

This can be avoided by mixing with another U(l) coming from the second E$. At any 
rate, here we are mostly interested in implications for instanton contributions to the 
superpotential. 

If q x y^ then a worldsheet instanton wrapped on Q cannot contribute to the super- 
potential, because the classical exponential factor is not gauge invariant: 

e -T Q _+ e -T Q -2* iq XX x (2>90) 

Instead we will get a prefactor that is also not invariant and cancels the gauge variation of 
the exponential. In this way, one may generate superpotential terms which are forbidden 
at tree level due to gauge invariance. But as long as the charged fields have vanishing 
expectation value, this does not generate a potential for Tq. 

On the other hand, if Tq shifts under a gauge transformation, then we already get a 
potential perturbatively through the D-terms. The Kahler potential is given by 

K = -M 2 Pl log(S + S*- 2q x V x ) - 3 M 2 Pl log if.T-ffc d ijk (2.91) 

with 

fi = ReT t -q x V x (2.92) 

Assuming q x ~ Tr(Q x ) = 0, from this Kahler potential we get 



x ^dK_ 
§ dV x 



v x =o JJAJAJ 
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M 2 

' Pl ' Cl (L x )AJAJ (2.93) 



The D-term potential is given by 

Vd = iRe(S)- 1 (V - ]TQJM 2 ) 2 (2.94) 

Without further information about the superpotential, we do not know if the tp can get 
a VEV. At zero VEVs the modulus qfJC^Re^Tj) picks up a mass through the D-term 
potential. This is expected by supersymmetry, because we already saw that the imaginary 
part picked up a mass through the Stiickelberg mechanism. In this case the mass to be 
of order g s M s . If ip gets a large VEV, then the U(l)x gauge boson will eat the (p field 
instead of a Kahler modulus, and the Kahler modulus may become massless again. The 
massive U(l)x will have a mass of order the KK scale, and we have to re-expand around 
the correct vacuum. 

Although an instanton wrapped on Q does not contribute to the superpotential, it 
could generate charged couplings non-perturbatively. Let X denote a chiral superfield 
with charge q x . One of the simplest couplings that could be generated this way is the 
Polonyi superpotential 

W = /j, 2 Xe~ TQ (2.95) 

Actually this is not an honest Polonyi superpotential but rather a mixing between X and 
Tq. At any rate, let us see how such a term could get generated. 

We first review how to construct an extra U(l)x symmetry. We assume for simplic- 
ity that the holonomy is contained in SU(n), and take the heterotic bundle V to be 
decomposible: 

V = V' + V". (2.96) 

Since Ci(V) = 0, we have 

det(y') = detiV")- 1 (2.97) 

The extra U(l)x symmetry is the subgroup of SU(n) C E 8 that commutes with the 
holonomy of V. The internal part of the gauge field of this U(l)x is a connection on a 
non-trivial line bundle on Z, given by Lx = det(V'). 

Charged chiral fields correspond to generators of H X {Z, ad(E 8 )). It is not hard to see 
that the only fields X that are neutral under the GUT group but charged under U(l)x 
correspond to a generators of Ext 1 (l // , V") or Ext^V", V). For definiteness, let us say 
that w x G Ext 1 (l /// , V). The vertex operator is of the form 

w x = w x {z)- zJ dzTl ] X i X ] (2.98) 

where % is an index valued in V and j is an index valued in V". 

We assume that 5Tq ^ 0, so that an instanton wrapped on Q does not contribute to 
the superpotential. Now we want to check for a coupling of the form AW = Xe~ Ta . In 
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this case, we are supposed to compute the correlator 

d x W oc / dM J i*wf A (J 1 ) (2.99) 

where J 1 is the current A*A J , which carries a non-zero U(l)x charge. Clearly this vanishes 
unless we have precisely two fermionic left-moving zero modes to kill the current, and 
absorb the U(l)x charge: one zero mode for A* for some i, and one for V for some j. 

As usual, the bundle V splits when restricted to Q. Since J' F x ^ 0, the restriction 
V\q cannot be balanced. We decompose 

V'\ Q = Q)0(a i ), V"\ Q = Q)0(b 3 ), 5> + J> = ( 2 - 10 °) 

In the minimal case, we have 

/ Cl (V) = f Cl {L x ) = 1, / Cl (V") = - I Cl {L x ) = -1 (2.101) 

Jq Jq Jq Jq 

Generic bundles V and V" with this property have splitting types 

a, = {1,0,0,...}, b 3 = {-1,0,0,..} (2.102) 

for our rational curve Q. This yields precisely the right number of left-moving zero modes 
on Q. We have essentially met such a splitting type before in section 2.5, however here 
the presence of zero modes is guaranteed by J' F x ^ and the splitting type is preserved 
under a generic deformation. If J ci(L x ) > 1, there would be additional zero modes and 
we would not be able to generate a term of the form Xe~ TQ , but we might be able to 
generate X m e~ TQ with m > 1, a Yukawa coupling, or a higher dimension operator like 
the Weinberg operator. 

Suppose that both V and V" are constructed from a spectral cover. From the point 
of view of the spectral curve, £37 has split into two pieces: 

S 37 = S^UE'gV, (2.103) 

where 

£37 = *z\Q) n C, x' 3 ' 7 = <k- z \Q) n c" (2.104) 

In the minimal case we get one zero mode on E 37 with charge +1, and one zero mode on 
S 3 ' 7 with charge — 1. A somewhat similar splitting phenomenon seems to occur when we 
take the lib limit in F-theory, as we will discuss later. 
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3. Mb instantons 

As in the heterotic string or type lib, the superpotential in F-theory satisfies a simple 
non-renormalization theorem. Let us briefly recall the argument. Supersymmetry implies 
that the Kahler moduli space is a complex manifold. Given a basis of four-cycles Si in 
F 3 , holomorphic coordinates on the moduli space are given by 



T t = vol(Si)+i / C 4 (3.1) 

with volumes measured in ten-dimensional Planck units. Note that the Tj shift under 
gauge transformations of the RR field C4, hence such shifts are isometries of the Kahler 
moduli space. F-theory is defined as a large volume expansion, so the small parameter 
in F-theory is a Kahler modulus. For instance, the gauge coupling constant olqut * s 
identified with the real part of some Tj. 

Now the superpotential must depend holomorphically on the Tj. Then because of the 
shift symmetry, the superpotential can depend on the T, only as 

exp(-T,) (3.2) 

In other words, the superpotential calculated by algebraic geometry at tree level is ac- 
tually exact to all orders in the expansion parameter. It can receives corrections only 
non-perturbatively, for example from F3-instantons. This is why F3-instantons are im- 
portant - although small, they provide some of the leading non-vanishing corrections to 
the superpotential. 

We consider a D3 instanton wrapped on a four-cycle in F 3 , the internal manifold of 
our compactification. A precise way to define an F-theory vacuum is to take an M-theory 
vacuum on a Calabi-Yau four- fold I4 that is elliptically fibered over F 3 , and then take the 
limit in which the elliptic fiber shrinks to zero. In this description, the D3 instanton in 
F3 descends from an Mb instanton in I4 wrapping the T 2 -fiber, and 7-branes are encoded 
in the geometry of the elliptic fibration. 

In this section we discuss how the M5-brane sees the background geometry and fluxes. 
We then discuss some aspects of Mb instanton corrections in an F-theory compactifica- 
tion, and make contact with section 2. 

3. 1 . Scalars and fermions 

The Mb worldvolume has (0, 4) supersymmetry and contains a single superconformal 
tensor multiplet. Under the 5*0(4) little group and USp(4) = SO(b) F-symmetry group, 
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the supercharges transform as (1,2; 4). The tensor multiplet consists of a self-dual two- 
form B + transforming as (1,3; 1), and five scalars (1,1; 5). The fermions live in (1,2; 4) 
and satisfy a symplectic Majorana condition (in Lorentzian signature). Reduction on T 2 
yields the N = 4 Yang-Mills multiplet. 

The fermionic part of the Mb action is of the schematic form 



1 



Lf 5 = -0[JP+P\0 (3.3) 

In order to understand the fermionic zero modes, we may first consider setting G to zero. 
The G-flux appears as a kind of mass term, so the effect of turning G back on will be to 
lift some of the would-be fermionic zero modes. 

Our M5 is wrapped on a divisor D of Y4. Accordingly, we split the normal bundle as 
R 3 © N where N is a complex line bundle. Since N is the normal bundle to the divisor D 
in the Calabi-Yau four-fold, it follows from adjunction that N is the same as the canonical 
line bundle Kp on D. Spinors on the M5 with chirality (—1)* are sections of 

S + = nPWp.R)®/^/ 2 (3.4) 



Since the tensor multiplet spinors have positive chirality on D, we only take i even. 

However as mentioned above, the tensor multiplet spinors also transform as a 4 under 

the USp(4:)r symmetry group, i.e. the spinor of SO(5)r. When the M5 wraps a divisor 

D in a Calabi-Yau four-fold, this is broken to SO(3)r x U(1)r where the second factor 

is identified with the structure group of the canonical bundle Ku of D. The 4 of SO(5)r 

splits as 

4 = 2i©2_i (3.5) 
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of SO(3)r x U(1)r. Therefore, the tensor multiplet spinors actually transform as 

s+ © (k'J 2 © k~ 1/2 ) = n°i © ^ © nf, © n 3 * (3.6) 

2 2 +2 +2 

under the U(3) structure group of the metric restricted to the divisor D, as well as the 2 of 
SO(3)r. The ±| is to remind us of the U(1)r charges. The zero modes in the absence of 
flux correspond to global holomorphic sections. Therefore we get two universal fermionic 
zero modes from h°'°(M5), as well as two non-universal zero modes for each generator of 
H°' i (M5),i = 1,2,3. 

When we turn the G-flux back on, zero modes of Hodge type (0, 2) may get lifted 
[30, 31]. The flux induces a map 

G : n°' 2 (D) ->■ n 2 '°(D) (3.7) 
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Specifically 

(G9) ab = n abcn G cnS % f - (3.8) 

where Q denotes the holomorphic (4, 0) form, restricted to D. These equations can get 
further modified in the presence of flux for the chiral two-form. The surviving fermionic 
zero modes are in the kernel of this map. However we will mostly be interested in situations 
where H 0,1 (M5) = H 0,2 (M5) = 0. In this case there are no fermionic zero modes that 
could be lifted, and the presence of G-flux is irrelevant in this regard. 

Besides the fermionic zero modes, we also have bosonic zero modes. The five scalars 
yield sections of T(M5,N) © R 3 . /,From this we recover three of the four universal 
bosonic collective coordinates of the instanton, as well as non-universal bosonic zero modes 
counted by h°(M5,N) = h 0,3 (M5). The expectation value of the chiral two-form B + 
through the T 2 decompactifies and gives the remaining universal Euclidean R in the F- 
theory limit. This zero mode is never lifted by the background CVfield as a three- form 
with zero or two indices in the T 2 does not exist in F-theory. The remaining contributions 
of the chiral two-form do not lead to vanishing of the partition function for generic C 3 , 
but they are much more complicated to understand. They will be discussed separately in 
section 3.3. 

3.2. Fluxless backgrounds 

Since fluxes are small perturbations in the large volume limit we may first find instan- 
tons and their zero modes for zero flux, and then consider turning on the flux as a small 
perturbation. D3 instantons in the absence of flux were studied by Witten [32]. Let us 
review some of the results. 

The D3 lifts to an M5 on a divisor D in Y4. The axionic part of the Kahler modulus Tp 
is not invariant under rotations of the normal bundle. Indeed from the lid supergravity 
action of C 3 

1 r .„ 1 



2(2ir] 



dC 3 A*dC 3 + ±-Jc 3 Al s + — !-p Jc 3 AGAG (3.9) 



we find that 



SC 6 = I^\e,R) + ^-GAA (3.10) 

so Te> may shift under gauge and Lorentz transformations. Here A = 2n\xOJ X where 
u x is a generator of the coroot lattice, i.e. a generator in H 2 {Y^) orthogonal to classes 
in <jb 3 *H 4 (B 3 ) and 7TyH 6 (B 3 ), and Ax is an infinitesimal gauge transformation for the 
corresponding U(l)x- 

In [32] it is conjectured that 

S Qn f C 6 = -Q nX (D,O d ) (3.11) 

J D 

29 



where 0^ is an infinitesimal U(l) rotation on N, the normal bundle to D in Y4. Let us 
try to get this directly from (3.10). The anomaly polynomial is given by 



1 
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p 1 {TDf+p l {NDf-2p 1 {TD)p 1 {ND) 



p 2 (TD)-p 2 (ND) 



(3.12) 



In our situation ND = N © R 3 . Since we are interested in a rotation of the normal 
bundle, we only need to look at the pieces that depend on N. (The normal bundle will 
eventually be identified with the anti-canonical bundle Kp, but we do not want to do a 
simultaneous rotation on Kp, as that would change the /^-charges of the fermions (3.6) 
and the chiral two-form). Furthermore, p 2 (N) vanishes and pi(N) = Ci(N) 2 . Then we 
apply the descent procedure 



dl 



(0) 



Se 



T-(O) 

N A 7 



dh 



(3.13) 



The first step is ambiguous, because there is a one parameter family of Chern-Simons 
forms with exterior derivative given by p\(T 'D)pi(N) . We pick one on the criterion that 
ci(iV) 3 should ultimately cancel, as it tends to give fractions with large denominators. 
This leads to 



r(l) 



D -0 



N 



4-4£ 



c 1 (Nf-2±p 1 (TD)c 1 (N) 



+& N ^-c 2 (TD) Cl (TD) (3.14) 



Modulo a factor of — |, this recovers — 0^ times the index density for x(D, Op). 

The resulting anomaly of the exponential factor exp(— To) is cancelled by the one- 
loop determinants of the worldvolume fields, since the anomalies of the worldvolume 
fields cancel with the anomaly inflow. Since the chiral two-form does not transform under 
normal bundle rotations, the anomaly will come from the fermions. ^From (3.6) we see 
that the net anomaly due to fermion zero modes is given by x{D, Or,)-, which cancels the 
anomaly from the exponential factor precisely when (3.11) holds. (By contrast, possible 
gauge anomalies of exp(— Tq) due to (3.10) are cancelled by the partition function for the 
chiral two- form on the M5-brane, as we will see later). 

The four-dimensional supercharges carry charge ±| under such normal bundle rota- 
tions, so we identify this U(1)r with the Ad U(1)r symmetry. In order to contribute 
to the superpotential, we get the two universal fermionic zero modes which each carry 
charge one-half, and generically no other fermionic zero modes. Since the anomaly due 
to the universal zero modes d 2 6 is equal to one, it follows that an M5-brane wrapped on 
D can only contribute to the superpotential if the remaining pre-factor has charge zero, 
and therefore the exponential factor has the opposite variation, i.e. 



X (D,O d ) = 1 
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(3.15) 



This analysis applies to smooth divisors. In F-theory we are typically interested 
in cases where D is not smooth. However when we go to M-theory we expect that 
singularities of I4 can be removed by a simultaneous resolution. Further we would not 
expect to get extra zero modes in the F-theory limit, because it corresponds to varying 
a Kahler modulus and the one-loop determinants we are interested in don't have any 
dependence on the Kahler moduli. Therefore let us perform such a resolution of Y 4 and 
analyse the condition there. 

We would like to distinguish two cases: 

(i) The D3 worldvolume is not contained in A; 
(ii) The D3 worldvolume is contained in A. 

Let us first consider type (i) under heterotic/F-theory duality. Such instantons get 
mapped to worldsheet instantons. We can relate the Betti numbers (or even the Hodge 
numbers) through the Leray sequence. Let us discuss this for the case that S = K3 
or S = dPg, which arises in the stable degeneration limit. The F2 term in the Leray 
sequence is given by H P (Q, F%*Q), where F%*Q is a sheaf on Q whose fiber at a point 
p on Q can roughly be identified with the rational cohomology of 7T _1 (p). We work 
over the rational numbers so that we can neglect torsion effects. Now if the fibration is 
reasonably well-behaved, then all the fibers are are dPg surfaces, and hence R l and R 3 
vanish identically. In our well-behaved case, we also have that R° and F 4 are globally 
constant, and so H\Q,R°) = H%Q,R A ) = /P(Q,Q). In particular, h°(Q) = h 2 (Q) = 1 
and h}(Q) = 2gQ. Therefore we get following table for H p R q , starting with degree (0,0) 
in the bottom left corner end ending with degree (2,4) on the top right: 

1 H 2 (Q,R 2 ) 1 

2g Q H\Q,R 2 ) 2g Q (3.16) 

1 H°(Q,R 2 ) 1 

Next we need to look at the d 2 differential. By definition, a generator of H P (Q, F%*) 
corresponds to a generator a p ' q G Q p (Q,Q q (S)) such that 

d s a p ' q = 0, d Q a p ' q = -dsa p+l ' q ~ l (3.17) 

for some oP +1 ' q ~ 1 . Since we are really interested in the cohomology of the total differential 
d = ds + dQ, we simply check how far we succeeded: 

d{a p ' q + a p+l ' q - 1 ) = d Q a p+1 ' q ~ 1 (3.18) 

So our candidate a p,q +a p+1,q ~ 1 may lift to rf-cohomology if rf 2 (o; p ' 9 ) = dQO p+1,q ~ 1 vanishes. 
In our case we see from the table that this differential already vanishes, so the non-zero 
cohomology groups in the table all correspond to generators of H p+q (M5, Q). 
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We are mostly interested in instantons with only the two universal fermionic zero 
modes, i.e. we want h°' l (M5) = for % > 0. To get h ' 1 = we clearly need qq = 0. 
To get h ' 3 = is is more convenient to use the isomorphism h ' 3 = h°(N) and check if 
the normal bundle has sections, i.e. if the instanton is isolated. The h ' 2 must come from 
H°R 2 . If S = dP$ we wouldn't get any. If S — K3 the monodromy would typically kill 
it. Thus the arithmetic genus criterion for the M5-brane agrees well with the heterotic 
picture. On the heterotic side, the instantons that contribute are wrapped on a genus 
zero curve and isolated. Higher genus curves would contribute to certain multi-fermion 
terms. Non-isolated curves might possibly still contribute to the superpotential (although 
probably they do not), but one has to understand how to integrate over the family, just 
as for the M5-brane. 

The meaning of some of the remaining cohomology groups might seem somewhat 
obscure. For instance if 1 /? 2 could be quite large but hasn't yet played a role for us. We 
can get much more insight in this case by using the spectral cover construction. Recall 
that the data of a dP$ fibration over Q is equivalent to a spectral cover in an elliptic 
fibration over Q. There is a direct mapping between the cohomology of the spectral curve 
(previously called £37 in section 2) and the 'primitive' cohomology of the dPg fibration, 
called the cylinder map [33]: 

H™(Z 37 ) -)• Hi +1 ' q+1 (M5) (3.19) 

In particular this maps H 0,1 (Ti 3 i) — > H 1,2 (M5) and allows us to directly relate the Jaco- 
bian of E 37 to the intermediate Jacobian of the Mb. We saw that the Jacobian actually 
played an important role in the heterotic string, through the partition function of the 
left-movers. Similarly, a non-zero flux through Q gets lifted to a non-zero flux though 
£37, which gets mapped to a GVflux through a four-cycle of the M5-brane using the 
cylinder map. On the heterotic side we saw this corresponds to gauging shift symmetries 
of the Kahler moduli and modifying the zero mode structure of the worldsheet instanton. 
We will see the analogous role of the intermediate Jacobian and the flux in the M 5-brane 
story in the next section. Thus eventually all the Hodge numbers of the Mb play some 
kind of role. 

More generally, suppose that we consider instantons of type (i) but the Mb does not 
admit a surface fibration. Then we can only make use of the Leray for the elliptic fibration: 

H°(D3,R 2 ) H\D3,R 2 ) H 2 (D3,R 2 ) H 3 (D3,R 2 ) H 4 (D3,R 2 ) 

H°(D3,R 1 ) H 1 ^, R l ) H 2 {D3,R 1 ) H 3 (D3,R 1 ) H\D3,R 1 ) (3.20) 

H°(D3,R°) H 1 ^^ ) H 2 (D3,R°) H 3 (D3,R°) H\D3,R°) 

where we used the shorthand R l = i?V*Q. We will assume that D3 is a rational surface 
(i.e. del Pezzo, Hirzebruch, or a blow-up thereof), because isolated divisors are often of 
this type. 
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1 + H°(D3,R 2 ) 


H\D3,R 2 ) 


H 2 (D3) + H 2 (D3,R 2 ) 








H 1 {D3,R l ) 


H 2 (D3,R r ) 


H 3 (D3, R l 


1 





H 2 (D3) 






For generic models (but still with resolved ALE singularities allowed), R° = Q; R 1 is 
a varying rank two sheaf generated by the two one-cycles of the T 2 ; and R 2 = Q + R 2 
where R 2 is a torsion sheaf, corresponding to the number of exceptional cycles that we get 
on the locus with enhanced gauge symmetry. We can use this to simplify the table. We 
have H l (D3, R 2 ) = for i > 2, H l (D3, R°) = H\D3, Q), and if D3 is a rational surface 
then H\D3) = H 3 (D3) = 0. Generically we also have ^(Z^i? 1 ) = 0, and by duality 
H 4 (D3,R 1 ) = 0. Under these genericity assumptions, we get 

1 

1 

(3.21) 
The remaining entries are expected to be non-vanishing generically. The Betti numbers 
will depend on the differential g?2 : H p R q — > H p+2 R q ~ 1 , which may lift some further 
generators. Again we have h ' 1 = 0, and h 0,3 = is the instanton is isolated, but it is 
much harder to make a clear statement about h ' 2 and it could well be non-zero. On 
the other hand, h 0,2 might still get lifted by G-fluxes, so we might expect fairly generic 
isolated D3 instantons wrapping a rational surface to contribute to the superpotential. In 
anticipation of the next section, we note again that even simple M5 branes intersecting 
the discriminant locus typically have a large number of three-cycles. 

Next let us consider case (ii). If the fiber type is of type I±, then the elliptic fiber 
has degenerated to a rational curve. However the curve has a double point and the 
arithmetic genus of this curve is the same as for an elliptic curve, i.e. one. Therefore 
x{M5) ~ x{D3)x{T 2 ) = 0. It follows that such an instanton should not contribute to the 
superpotential in F-theory. 

This might seem somewhat counterintuitive from the lib perspective, as a D3-instanton 
on top of a 7-brane in lib is generally thought to contribute. The extra two fermionic 
zero modes implied by x = are said to impose fermionic ADHM constraints, rather 
than lead to vanishing of the superpotential contribution. It is possible that we should 
be more careful because the Mb is singular. However if the arithmetic genus criterion 
should be modified, one should argue this directly in the M-theory language rather than 
by comparing with type lib. The properties of an instanton can easily change in the Sen 
limit, and one should be careful not to extrapolate beyond the regime of validity. We will 
see some examples of this in section 4. Moreover if we further degenerate the fiber (which 
we discuss next), we seem to get results consistent with gauge theory. 

Moving on, now let us assume that the fiber type is worse then Ii, i.e. the D3- 
instanton wraps the same cycle as a 7-brane with non-abelian gauge group G. In this 
case the M5-brane should behave just like a gauge theory instanton. This can be verified 
from the M5-picture, to some extent. The elliptic fiber over the D3 splits up into a chain 
of P-'-'s, one for each node of the affine Dynkin diagram associated with the Kodaira fiber 
type, satisfying 

J2d t [P i ] = [T 2 ] (3.22) 
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where di are the Dynkin indices. If the singular locus is of split type, then for each P 1 we 
get a divisor Di, consisting of a Perforation over the P3 with fiber Pj. For non-split type 
we get fewer such divisors, as some of the P» are related globally by monodromy. The 
M5-brane can wrap each of the Di. In the context of M-theory compactified on such a 
Calabi-Yau four-fold, these M5-branes may be identified with the monopoles/fractional 
instantons of the non-abelian gauge theory. 

In three dimensions the N = 2 vector multiplet has an adjoint scalar $. Vacuum 
configurations satisfy [$, $] = 0, so we may diagonalize $. Let us introduce rank(G) + 1 
real scalars denoted by fa. Geometrically the fa specify the sizes of Pj, which can be finite 
in the M-theory context, and they are defined only up to Weyl transformations, which 
means we can restrict them to take values in a fundamental domain. From (3.22) we have 



Y,di 



vol(T 2 ) = 1/R (3.23) 



The rank(G) linear combinations of fa orthogonal to this correspond to the eigenvalues of 
$. Now let us assume that the base is a del Pezzo surface, so that h 0,1 (S) = h 2,0 (S) = 
and we get a pure N = 2 gauge theory in three dimensions. The superpotential of the 
three-dimensional gauge theory is given by the partition function. We can again apply the 
Leray sequence, yielding h 0,l (Dj) = for % ^ 0, so each Dj contributes to superpotential. 
Further if there are no monodromies among the Pi, then h 3 (Di) = and the partition 
function for the chiral two-form is trivial. Hence the partition function is given by [34] 

W = ^M-drfa/gi) (3.24) 

Since wrapped Mb branes correspond to monopoles, this is reminiscent of the well-known 
results of Polyakov [35]. Solving for the P-terms yields h y vacua, where h w is the dual 
Coxeter number of the non-abelian gauge group G. 

The relation of these vacua with the Ad gauge theory vacua arising for R — > oo is 
somewhat subtle, but can formally be obtained as follows. We introduce a Lagrange 
multiplier field S to impose the constraint (3.23). The superpotential becomes 

w = s(t - J2 difa/gl) + J2 eM-^fa/gl) (3.25) 

where we used the relation g\ ~ Pgf . Upon integrating out the fa and using J^di = h y — \ 
one obtains 

W = rS + h y S(\og(S/A 3 )-l) (3.26) 

which is the Veneziano-Yankielowicz superpotential for the gaugino bilinear S ~ Tr(AA). 
It is expressed purely in terms of 4<i quantities, so we can take the 3d — > 4d limit. We can 
also integrate out S to get 

W = -h v A 3 e- T/hV e 2nik/hV (3.27) 
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in the kth vacuum. Although it looks constant, in field theory the meaning of this 
superpotential is that AW calculates the tension of domain walls. In a gravity theory, 
A ~ Mpi exp(—l /bogl(Mpi)) depends on the moduli and is not a constant. 

In the F-theory limit, we cannot wrap an M5-brane on each D t separately, but only 
on the sum ^djDj. Such an M5-brane is singular, but the holomorphic Euler character 
of such a divisor vanishes, so we expect the M5-brane does not contribute to the superpo- 
tential. Indeed in the four dimensional gauge theory this superpotential is not generated 
by instantons but by strong dynamics, consistent with the arithmetic genus criterion [32]. 
If the M5 contributed, it would indicate a stringy correction to the gauge theory result, 
which we believe to be absent (as it would modify the E 8 gaugino condensation story for 
example). 

Actually getting such pure gauge groups is somewhat rare. In M-theory compactifi- 
cations to three dimensions, we can certainly construct ALE fibrations to get any desired 
gauge group. However in order for such a compactification to lift to F-theory, the compact- 
ification must admit an elliptic fibration, and this imposes some important constraints. 
More typically, embedding in an elliptic fibration will force the presence of matter curves, 
where the elliptic fiber further degenerates. Such matter curves are closely related to 
anomaly cancellation conditions in six dimensions. If the matter curve has genus one or 
larger, and there is no G-flux, then there are massive quarks which can becomes massless 
at special loci on the moduli space. 

Some special cases were studied in [36]. Since the M5-branes correspond to monopoles 
in three dimensions, one can also understand their contributions more directly from the 
gauge theory perspective [37]. Taking the R — > oo limit should then yield the Ad super- 
potential. 

3. 3. The chiral two-form and holomorphic factorization 

The most interesting field propagating on the M5-brane is the chiral two-form. Let us 
first discuss its partition function from a down-to-earth point of view, to see how theta- 
functions arise. Then we move to a more abstract point of view. Most of the statements 
and manipulations regarding theta-functions and holomorphic factorization have well- 
known analogues on higher genus Riemann surfaces. Mostly following [38, 39, 5]. 

The basic problem with the theory of a chiral two-form is that it can not have a 
conventional Lagrangian description. Indeed, suppose we try to write one. By self-duality 
we have 



HA*Hoc HAH = (3.28) 

M5 JM5 

We can however write the Lagrangian for the theory of a non-chiral two-form, which 
contains both a chiral and an anti-chiral two-form, in such a way that the anti-chiral part 
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decouples from the chiral part. Such an action is given by 

1 



S= / -\H-i*C 3 \'-iHAi*C 3 (3.29) 

J Mb 2 

where H is not required to be self-dual. The art is then to compute observables using the 
non-chiral two-form, and to extract the results for the chiral two-form by holomorphic 
factorization. Let us discuss this procedure for the partition function. 

In the partition function, we have to sum over the fluxes of B. Let us choose a dual 
basis of 3-cycles {A { , B^} in # 3 (M5, Z): 

A 1 n Bj = 5) (3.30) 

In a suitable basis, the *-operator has the following eigenvalues: 

*c/<° = -i a; 3 ' , *u 2 > 1 = +t u 2 >\ *u 1 ' 2 = -i lu 1 ' 2 , *oj°> 3 = +t u°> 3 . (3.31) 

We take a basis Uj of H 2,1 (M5) + H 0,3 (M5), such that *Uj = iuj. Then up to an SO(n) 
rotation we have 

/ Wj = 5 l p / Qj = Tij (3.32) 

where r^ = Tji is the period matrix. 

Now we decompose H = dB into a harmonic piece (the flux), which we can think of 
as a classical field configuration, and an orthogonal piece which contains the quantum 
fluctuations. We may expand the fluxes as 



27rn J = / H, 2nmj= / H (3.33) 

J A 1 JBj 

We further write 

C 3 = 2vr z l uji + c.c (3.34) 

To obtain the classical partition function, we must evaluate the path integral on all 
the classical field configurations: 

Z (t,z) = J2 e" Scl[T ' z ' m ' n] (3.35) 

In the present context this sum was evaluated carried out in [39]. After Poisson resum- 
mation, and removing an anomalous factor, it can be written as a sum of squares of theta 
functions: 

Z (t\z) ~ £|©g](rk)| 2 (3.36) 
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where 

9[5]( T I*) = J2 e Mi^n j 2iriT ij + 2Tvin l (z l + <j) i )) (3.37) 

z+e 

Since the action we wrote really describes both the chiral and anti-chiral two-form, we 
now take a holomorphic square root to get a partition function for the chiral two-form 
only. However there is no unique choice for the classical partition function. Rather, there 
is a unique partition function for every choice of spin structure. 

In addition, we have to evaluate the path integral over the quantum fluctuations and 
factorize the answer, formally described in [39]. This does not depend on the choice of 
spin structure. We get that the partition function for spin structure a,/3 is of the form 

Z+[«](t\z) = -¥±±1 (3.38) 

where 1/A + arises from the sum over quantum fluctuations. Since it is nowhere vanishing 
and independent of the spin structure, much of the interesting information is contained 
in the classical theta-function. 

We can also consider the more abstract point of view. The partition function is a 
section of a line bundle on the intermediate Jacobian, which we need to specify. We 
can do this the same way as for Riemann surfaces. The Hodge *-operator induces a 
complex structure on the Jacobian. This is also known as the Weil complex structure. 
The intersection pairing induces a principal polarization u. The line bundle is defined by 
specifying the phases = ±1, subject to 

0(a + b) = (-ir^0(a)0(6), 0(1) = (-1) 2 *, 0(r) = (-l) 2 ' 3 (3.39) 

which give the monodromies, and Chern class u, which is positive definite. By the in- 
dex theorem, for each spin structure we get a unique theta function, corresponding to 
the unique holomorphic section of the line bundle, which we identify with the partition 
function. 

There is another well-known version of the Jacobian with a different complex struc- 
ture, known as the Griffiths Jacobian. It corresponds to an involution with the same 
eigenvalue for H 3 '°(M5) and iJ 2,1 (M5). The Griffiths Jacobian is known to vary nicely 
in holomorphic families. For Calabi-Yau three-folds for instance this can be seen in the 
special geometry relations: 

[ tt = z\ f Q = dT/dz j (3.40) 

The differentials difl span H 3,0 + H 2 ' 1 , and the period matrix r^ = didjj 7 depends holo- 
morphically on the z l . (In special geometry the overall rescaling of the z % is considered a 
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gauge symmetry, but in our situation it is a physical modulus and corresponds to moving 
the M5 in the normal direction). However if h 3,0 and h 2 ' 1 are both non-zero, then u is 
not positive definite. As a result, instead of having a section, C has higher cohomology 
and the theta function does not exist. If we would try to construct it as a series as we 
did earlier but instead with the indefinite norm, we would find that the series diverges. 

The theta functions on the Weil Jacobian do not suffer from this, as we might expect 
physically. However there is a price to pay; unlike the Griffiths Jacobian, the Weil Jacobian 
generally does not vary holomorphically in families. As we can see from the Calabi-Yau 
example above, in the Weil complex structure the period matrix r is not a holomorphic 
function of the moduli. In other words, in general the partition function of a chiral two- 
form suffers from a holomorphic anomaly. The remaining contributions to the partition 
function from the scalars and fermions appear to vary holomorphically. 

Fortunately for isolated instantons, we have h 3,0 (M5) = and the Weil and Griffiths 
Jacobians coincide. So we do not get an immediate contradiction with the holomorphy of 
the superpotential. Non-isolated instantons might still contribute to the superpotential 
after integration over the family. Perhaps we should take this as evidence that non-isolated 
instantons in fact do not contribute to the superpotential. 

Finally, we should take an appropriate linear combination of these partition functions 
together with those of the bosons and fermions, so that we end up with a theory that is 
free from global anomalies as well. The general prescription is not clear to us, but at least 
in the cases we consider in detail there is a close relation with the heterotic string and so 
there is a natural expression. 

As an aside, the vanishing of the partition function of the chiral two-form cannot 
be ascribed to its zero modes. The chiral two-form is a bosonic field and has periodic 
identifications due to gauge invariance, so it behaves as a compact scalar. Furthermore 
the action does not depend on the VEV through a two-cycle. The integral over these zero 
modes thus only gives a finite overall factor and cannot cause vanishing of the partition 
function, so these zero modes can be safely ignored. The one exception to this is the VEV 
through the elliptic fiber, which becomes non-compact and is identified with the emerging 
Euclidean R in the F-theory limit. 

All our above discussion assumed that G|m5 = in i7 4 (M5). Is this necessarily 
the case? Let us first recall that any G-flux in an F-theory compactification must be 
orthogonal to four-cycles of the following two types: 

(i) <Jb 3 *H\B 3 ) C H\Y,) 
(ii) tt* y H\B 3 ) C H\Y A ) 

Now the class of the cycle wrapped by the M5 is itself in ttyH 2 {B 3 ). Let us assume for 
now that i*i*G = 5 2 (M5) A G is a non-trivial class in H & {Y/\). We will return to the case 
that this fails later. Poincare duality implies that the intersection pairing if 6 (V 4 )nif 2 (l4) 
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is non-degenerate. Then modulo torsion, 

G\ M5 ^0 <* 5 2 (M5) AG Aco^O (3.41) 

for some u G H 2 ^^). Now u cannot be in 7T*i?y(S 3 ) or <Jb 3 *H°(B 3 ), because then 
5 2 (M5) Au is a class of type (i) or (ii), and the G-flux would be automatically orthogonal 
to it. Any other u G H 2 (Y4j is in the coroot lattice of the Ad gauge group, i.e. u = u x 
for some U(l)x gauge symmetry. Therefore 

G| M5 ^0 «■ J GAcu x ^0 (3.42) 

for some u x in the coroot lattice. 

This leads us to the F-theory analogue of the gauged shift symmetries that we en- 
countered for the heterotic string in section 2.7 (also discussed in v2 of [40]). Recall from 
(3.10) that a Kahler modulus T D shifts under a U(l)x gauge transformation when 

5T D = — [ G A A = 2ni\ x — [ G A u x = 2mq x \ x ^ (3.43) 

4vr J D 4tt J d 

The low energy Kahler potential must then be of the form 

Kr ~ -M 2 Pl log -L(T + T*- q x V x f (3.44) 

o ■ o 

The U(l)x in this case picks up a mass through GS couplings to the axion Im(Tc>) = f D Cq 
and one finds an Fayet-Iliopoulos term of the form 

£ x ~ Af^voKBa) -1 / G A u x A J (3.45) 

Jd 

with volumes measured in lOd Planck units. Furthermore, a term in the superpotential 
of the form 

d 2 de- T ° (3.46) 



is forbidden by U(l) x gauge invariance. So an M5-brane wrapped on D can not contribute 
to the superpotential, but it can generate couplings that are forbidden in perturbation 
theory due to the U(l)x symmetry. 

So let us consider an M5-brane with G\m5 ^ in H A (M5). In this case there is a 
tadpole for the chiral two-form, because: 

HACz-f BAG 4 (3.47) 
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and hence the partition function vanishes. We already saw the meaning of this in the 
heterotic setting in section 2.7; in this case there are chiral fermion zero modes, and to 
get a non-vanishing answer we need to insert some fermionic operators in the partition 
function to absorb these zero modes. 

Here too there are some natural operators we have to insert to get a non-vanishing 
answer. These are the Wilson surface observables discussed in [39]: 

W(Q) = e^ BAQ (3.48) 

where Q is a four-form in Mb. Dually we may think of Q as a two-cycle. Inserting such 
operators in the path integral: 

(W(Q 1 )...W(Q n )) ~ f d[B]e^ BAQl ---e^ BAQn e- s (3.49) 



such that 

G 



2n 



[Qi] + ■■■ + [Qn] (3.50) 



in H 4 (Mb), then there is no tadpole and we get a non- vanishing answer. Therefore these 
Wilson surface observables play the role of fermionic zero modes for the M 5-brane. Again 
such correlators can be computed (in principle) in the M5-brane theory using holomorphic 
factorization. 

In order to compute correlation functions on the Mb, analogous to section 2, we need 
the vertex operators on the Mb brane for deformations of the background corresponding 
to chiral fields. Chiral fields correspond to some particular simultaneous deformations of 
C*3 and the complex structure of the Calabi-Yau four-fold. The Wilson surface observables 
above should appear as a factor in these Mb vertex operators. It is not clear that such 
calculations will be very illuminating so we will not proceed along these lines. Instead we 
focus on a class of Mb instantons where the calculations can be be mapped to a more 
standard problem. 

Finally we return to the possibility that 5 2 (Mb) A G = even though i*G is a non- 
trivial class in H 4 (Mb). In terms of Poincare duals, this means that [G|ms] £ H 2 (Mb) 
is the boundary of a three-chain T in Y4. By wrapping an Ml brane on T with the 
opposite orientation, we can cancel the tadpole for the chiral two-form. However even if 
this configuration would be supersymmetric, it looks like a subleading effect, so at order 
exp(— T) we do not expect it to contribute to the superpotential. 
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3.4- M5 wrapped on a four-cycle: the MSW CFT 

Suppose the M5 worldvolume is fibered over a Riemann surface Q: 

S ->■ M5 

| (3.51) 

Q 

The partition function depends only classically on the Kahler moduli, through the expo- 
nential factor. As a result, we may change the metric on the M5-brane without affecting 
the one-loop determinants, as long as we keep the complex structure moduli fixed. Thus 
we can scale down the fiber so that the M5-brane collapses to a string, and consider the 
effective theory on this string. This reduces the problem of computing zero modes and 
the partition function to a problem on Q, where we can address them explicitly. 

Let us do the reduction. The scalars simply reduce to non-chiral bosons on Q. As for 
the fermions, locally on Q we have Km5 ~ Ks and 

fi°< 2 (M5) ~ Q ' 1 ^,^ ' 1 ^)) © n 0fi (Q,n°' 2 (S)) (3.52) 

Positive chirality spinors on the M5 are given by even (0, i) forms. Upon reduction and 
a judicious use of the *-operator on S, we get the following complex fermions 

S+ ® Q°'°(Q, (ft°'°(S) + Q°' 2 (S)) <g> 2 ± i 
S Q ®n°> (Q,n°> 1 (S))®2 ± i (3.53) 

When scaling down S, we should keep only the ground states on S, i.e. the global 
holomorphic sections. Thus even degree Dolbeault cohomology on S yield right-moving 
complex fermions on Q, and odd degree Dolbeault cohomology yields left-moving fermions 
on Q. The symplectic Majorana condition reduces to an ordinary Majorana condition. 

Similarly we can understand the reduction of the chiral two-form. In Euclidean space, 
the chiral two-form is imaginary self-dual. Expanding in self-dual and anti-self-dual two- 
forms on S, and taking ground states, we get b^S) right-moving chiral bosons, and b^iS) 
left-moving chiral bosons. Reduction with one or two indices along Q yields only massive 
fields. 

Finally we should also reduce the coupling to the F-theory three-form C3. Locally on 
Q this yields 62 (S) gauge fields. The coupling to the chiral two-form reduces as 

H + AC 3 ^ f d 2 zd z <p + A- z (3.54) 

M5 JQ 

The chiral bosons may be fermionized, and we end up with a collection of chiral fermions 
coupled to gauge fields. This puts us exactly in the type of situation studied in section 2, 
where we know how to calculate an instanton correction. 
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In particular, let us assume that S is a K3 surface. In this case we have b±(S) = 0, 
h ' 2 = 1 and (6^",6j) = (19,3). This is precisely the Narain data for the heterotic string 
in 7 dimensions, and together with the five non-chiral scalars and the eight real fermions, 
we recover all the physical degrees of freedom of the worldsheet theory of the Id heterotic 
string. 

In the context of F-theory, the F3 surface has some further special properties. The 
elliptic fibration on the K3 surface allows us to single out a (1, 1) sublattice, generated 
by the elliptic fiber and a section: 

Vl = [T 2 ], v 2 = [T 2 ] + [P 1 ] (3.55) 

Of interest are the masses of membrane BPS states, wrapped on these cycles. 2 On the M- 
theory side, these masses are proportional to the volume of the wrapped cycle in Planck 
units. On the heterotic side, the (1,1) sublattice corresponds to the momentum and 
winding charges (rig, mg) of a distinguished S l on the internal T 3 . Their masses are given 
by 

m(yi) = 2nn 8 /R 8 , m(v 2 ) = m 8 R 8 /2iT (3.56) 

The BPS states with these charges are the Dabholkar-Harvey states. We can follow the 
masses of these BPS states on both sides. In the F-theory limit of small elliptic fiber 
with area A ~ l/Fg, the distinguished heterotic S* 1 decompactifies, and the Narain data 
reduces to that of the 8d heterotic string, i.e. a lattice of signature (18, 2). Thus we may 
think of our MSW string as a heterotic string living in the base of a T 2 -fibration. 

If S — dPg we still get a chiral string, but with a Narain lattice of signature (9, 1). 
In the F-theory context, we further eliminate the (1, 1) sublattice corresponding to the 
elliptic fiber and a section of the dPg. The resulting lattice of signature (8, 0) is none 
other than the Eg lattice. This can be thought of as half of an eight-dimensional heterotic 
string, in the limit that we decouple the winding modes on the internal T 2 . As we already 
mentioned, the cylinder map in this case gives an explicit map relating the Jacobians on 
both sides, as well as the theta functions. We could also consider an M5-brane wrapping 
S = T 4 . In this case, we get a left-right symmetric string. 



2 In order to compare properly, we really have to express the masses in Id Planck units. 
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4. _D3-instantons in the lib weak coupling limit 

Let us recap what we have seen so far. F3-instantons in F-theory are strongly coupled 
objects where both electric and magnetic degrees of freedom are important, so we need 
some exact techniques in order to deal with them. The situation becomes more transparent 
when we interpret the D3 as a wrapped M5-instanton. 

The worldvolume of the M 5 contains a chiral two-form, which is inherently quantum 
mechanical and does not admit a classical description. Nevertheless there are some cal- 
culational techniques, primarily the method of holomorphic factorization. We identified 
a subclass of Mb instantons where we can further reduce calculations to two dimensions, 
where we get a heterotic-like CFT description. This connected our discussion on M5 
instantons with our earlier discussion on instantons in the heterotic string. 

Most of the paper has been fairly conventional and unsurprising, at least from the 
heterotic point of view. In this section we would like to turn to the problem of under- 
standing instanton corrections from a more lib like perspective, by taking a Sen limit. 
This involves changing complex structure moduli, rather than Kahler moduli, and so we 
might expect some qualitative differences to arise. 

In fact there appears to be some tension between the behaviour of F-theory instantons 
that we saw in this paper and D3 instantons in perturbative lib, especially in the 37 sector. 
This can be traced to the fact that the theory develops additional U(l) symmetries as we 
dial the string coupling to zero. The extra U(l)s impose strong selection rules in the lib 
limit, but they do not generalize to F-theory. This is already familiar for other couplings, 
such as the classical 10-10-5 Yukawa coupling in SU(5)gut models, and we will see it 
holds for instanton contributions as well. 

Our results are therefore completely consistent with effective field theory considera- 
tions: everything that is not protected by a symmetry could in principle be generated. 
To illustrate this, we show that some lib selection rules on instantons in the presence 
of chiral matter disappear in F-theory. This means that perturbative type II is not a 
good guide to these instantons, and further insights on summing the contributions and 
multi-covers will likely have to come from heterotic instantons. 

4- 1 ■ General picture 

Let us briefly recall some aspects of open string quantization and orientifolds in the 
'upstairs' picture, following the notation of sections 13.4 and 14.3 of [41]. There is al- 
ready a discussion of instantons in lib orientifolds available in the literature, see [13] in 
particular, but we will give a slightly extended discussion in this subsection and the next. 
We will use T>3 to denote instantons in the upstairs picture and D3 to denote instantons 
in the downstairs picture. 
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The P3 branes live in a Calabi-Yau three- fold X 3 , with a holomorphic involution a 
mapping Q 3 ' — > — Q 3 ' . The massless modes are of the form 

V^L/2 |0)jvs > IS0S1S2S3S4) , Jj2Si = -l (4.1) 

In a curved background this leads to the following 33 zero modes. First we have the 
modes whose internal wave functions are given by 

Ext°(i*L,i*L) = H (V3,O) (4.2) 

Here we apply a Ad raising operator V^i/2 ^° the g roun d state, giving us the four real 
scalars rr M describing the position of the instanton. By supersymmetry, the same Ext 
generator defines a state |(— |) 5 ) in the Ramond sector. Together with |(+^) 2 (— ^) 3 ) this 
gives a fermionic mode we call f/> 33 . From the complex conjugate of this internal wave- 
function (or using the dual Ext 3 generator) we also get fermionic zero modes |(— |)(+|) 4 ) 
and |(+|)(-|)(+|) 3 > whi ch we call 4>f. Here a, a denote SO (4) = SU{2) x SU(2) spinor 
indices associated to the uncompactified R 4 directions. 

By applying an internal oscillator if) l _ L \0) NS , we further get 33 zero modes whose 

2 
internal wave functions are given by 

Ext 1 (uL,i m L) = H Q {V3,K)®H l {V3,0) (4.3) 

These zero modes split up into modes that are even or odd under a*. 
The action of parity on the modes is given by 

P : a m -► ±e™ m a m (4.4) 

using + for NN and — for DD boundary conditions, and 

P:^j r ^ ±e mr ?/v (4.5) 

where the ± agrees with the action on a m in the Ramond sector, and is opposite in the 
NS sector. Thus the orientifold action on the zero modes is almost the same as for the 
77 zero modes of a 7-brane wrapping the same four-cycle. The only essential difference is 
that due to changing the boundary conditions from DD to NN along R 4 , from (4.5) we 
get an extra minus sign for some of the Ramond sector states. The action of parity on 
the universal modes from H°(T>3) is then given by 

x i ->■ 7~V T 7, ^ a -> 7"Vl7, fpa ->■ -7"Vl7 (4-6) 
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Hence for the 0(1) projection 7 = (1), we keep (x l ,^ 33 ) but project out ip 33 . Similarly, 
for generators of (4.3) we have 

A^- 1 - l A T 1 , Xa^l^xll, Xa^-l^xll (4.7) 

For instance, to go from |(— |) 5 ) to |(— \){+\) 2 { — \) 2 ) we apply two raising operators, 
one with NN and one with DD boundary conditions. This relates the parity action on 
tp a and Xa, with the extra minus sign from (4.5). One subtlety is that the action on ijf r is 
opposite for indices tangent to or normal to the brane. However in (4.3) we have mapped 
normal bundle valued forms to canonical bundle valued forms by contracting with Q 3 ' . 
Since a*Q 3 ' = — Q 3 ' , the combined action of parity and a* puts all the generators of 
(4.3) on the same footing, resulting in the orientifold actions listed above. Thus for even 
generators of (4.3) we get fermionic zero modes Xa, and for odd generators we get bosonic 
and fermionic zero modes (A,Xd), assuming the 0(1) projection. Although listed for 
completeness, we are actually interested in isolated instantons, so we assume there are no 
such zero modes. 

Finally we need to quantize the 37 strings. We will assume here that the D3 and D7 
are intersecting, rather than coincident. In the upstairs picture, there are zero modes 
with internal part given by 

Ext^i.LaJ.Lr) ~ H°{^ 37 ,L V 3 <g> L 7 <g> K V3 \^ :i7 ) (4.8) 

and similarly for the 73 strings. This is similar to a D1 — D9 system; in the NS sector, the 
zero point energy is positive, so we do not get any bosonic zero modes. In the Ramond 
sector the ground state energy vanishes, but the raising operators carry positive energy, 
so we cannot apply them to the ground state. Hence for each Ext generator we only get 
a 2d chiral fermion A on the intersection. The orientifold action relates the 37 and 73 zero 
modes. 

We have to be a little careful about the bundle we put on the P3-instanton. We 
assume vanishing 5-field in our discussion. Recall that due to the Freed- Witten anomaly, 
the gauge field on a 3-brane does not take values in an ordinary line bundle but in a 'fake' 
line bundle 

L = L <g> K- 1/2 (4.9) 

which is not necessarily integer quantized. Now world-sheet parity relates a gauge field 
to its dual, and hence 

P:L ->■ L v = (L v (g) K) (g) R- 1/2 (4.10) 

We can also understand the extra factor of K from the point of view of D-brane charges. 
The coupling to RR fields is given by 



/ ch(^L)A(X 3 ) 1 / 2 AC (4.11) 

JXz 



'x 3 
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where C is the formal sum of RR potentials. The extra factor of K yields the expected 
action on the Chern character, viz. 

chj(z„(L v <g> K)) = (-l) j+1 chji^L) (4.12) 

This states, amongst other things, that £>3-brane charges (j = 3) are preserved. If we 
simply had replaced L by L v , this would not have been the case. 

Now assume we have an irreducible 0(1) instanton. The Euclidean 223-brane gets 
mapped to itself under the orientifold action, so this implies that 

a*(L y (g)K) = L => L(g)a*L = K (4.13) 

Thus we can not take the trivial line bundle Ox>z on the V3, but from (4.9) we see that 
under favourable circumstances it is compatible with 'setting the gauge field to zero.' 
Given a solution, we can obtain further solutions for any generator of h 1 ' 1 (T>3)-. 

Now let us start comparing this with an Mb instanton in the Sen weak coupling limit. 
The coefficients of the Weierstrass equation 

y 2 =x 3 + fx + g (4.14) 

are written as 

/ = ~(b*-24eb 4 ) 

9 = -^(-b 2 3 + 36eb 2 b 4 -216e 2 b 6 ) (4.15) 

with bj a section of K^ 1 . Then we take a limit e — > 0, so that the generic fiber becomes 
of type Ii. In this limit, the elliptic fibration is given by 

y 2 = * 3 - Ts bl - so^ = "sk (b2 " 6x)(b2 + l2x)2 (416) 

Introducing a new coordinate y = y/(b 2 + 12a;), we can write this as 

f = -^(b 2 -6x) (4.17) 

This is the equation of a rational curve. The map (x, y) — > (x, y) identifies the two points 



(x,y) = (-ba/12, ±V-b 2 /576) (4.18) 
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on each fiber. Hence the generic elliptic fiber has degenerated to a nodal curve, a P 1 with 
two points identified. The two points that get identified define a double cover X 3 over B 3 , 
branched over b 2 = 0, which is a Calabi-Yau three-fold because b 2 is a section of Kg 2 . In 
other words, we get a Calabi-Yau three-fold X 3 defined by an equation 

£ 2 = b 2 (4.19) 

and sitting naturally inside the Sen limit of the Calabi-Yau four-fold. We identify X 3 
with the lib Calabi-Yau. 

The intersection of our Mb with X 3 yields a divisor, which we identify with the lib T>3 
instanton. This "D3-instanton is similarly a branched double cover over a divisor D3 in B 3 . 
It is invariant under the orientifold action £ — > — £, and generically irreducible. Assuming 
it intersects the orientifold locus, it should then correspond to an 0(1) instanton. 

The relation between the M5-brane and the D3 it is fibered over was largely discussed 
in section 3, and we merely need to take the limit. For the scalars, the normal bundle of 
the Mb is the pull-back of the normal bundle of the D3, and they have the same sections. 
There is one extra Euclidean normal direction for the D3, which is identified with j T2 B + 
in the M5-description. In particular the D3 inherits the four universal bosonic zero modes 
from the Mb. If the D3 is not tangential to the orientifold locus, then the normal bundle 
to T>3 is the pull-back of the normal bundle to D3. (Since the normal and canonical 
bundle are the same upstairs, this also means that the difference between the normal 
bundle and the canonical bundle to the D3 is given by the intersection with the branch 
locus). This pull-back may have additional sections, but the even sections (with respect 
to the orientifold action) are the pull-back of the sections downstairs, and recalling that 
the orientifold action on H°(V3,N) and H°(V3,K) differ by a minus sign, from our 
earlier discussion we see that these are precisely the ones that survive the orientifold 
projection. The odd sections give rise to fermionic but not bosonic zero modes after 
orientifold projection. 

Next let us consider the fermions. We have essentially already discussed this in section 
3, but let us also look at this from the point of view of the Leray sequence for Dolbeault 
cohomology 

W(Mb,0 M5 ) ~ H l (D3,O m ) + H^^R^Oms) (4.20) 

Here we simplified R n*O M 5 ~ H 0fi (T 2 ) <g> D3 = O m . Close to the Sen limit, R l it*0 ~ 
H 0,1 (T 2 ) <g) Od3 is constant almost everywhere on the base. Let us denote the generators 
of if 1 (T 2 ,Z) by a,j3, subject to the relations a 2 = (3 2 = 0, af3 = —(3a = 1. Then the 
(0, 1) form on T 2 is proportional to 

a+ = (Imr)- 1 ^-™) (4.21) 

The monodromy around an orientifold plane maps a+ — > — a+, and the monodromy 
around a D7-brane leaves a + invariant. We expect to see something similar in the Sen 
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limit, but the elliptic fiber has degenerated to a rational curve and there are no ordinary 
one-forms left. Instead we have to deal with meromorphic forms. Locally around the 
pinching S 1 we can write the equation of the elliptic curve as 

xy = e (4.22) 

and the (1, 0) form as dx/x. In the limit e — > 0, dx/x becomes a meromorphic one-form. 
Resolving the double point, we get a meromorphic one-form with opposite residue at the 
two poles. Hence such meromorphic one-forms are related to functions on X 3 odd under 
the involution. 

Let us denote by M5 e the Mb at finite e, M5q its Sen limit, and v : M5o — > M5q the 
normalization which separates the double point. Let us further define Od3_ by 

p D3 *O m = O m @O m . (4.23) 

In other words, O03- corresponds to functions on "D3 that are odd under the orientifold 
involution exchanging the two sheets. Then we have a short exact sequence: 

-)• O M50 -► v.Ofa ->• O m . -)■ (4.24) 

Applying the i?V*, i.e. taking cohomology along the fiber, we get a long exact sequence 
which implies the isomorphism 

i?V0M5 () « 0D3- (4.25) 

Therefore 

H 0>i (M5) ~ /J i ( J D3,C D3 ) + iJ^ 1 ( J D3,C D 3_) ~ fl°> i (P3)+ + if°' i - 1 (P3)_ (4.26) 

in the Sen limit. In section 3 we saw that a generator of H°' l (M5) gives rise to a fermionic 
zero mode ip a for % even and tpa for i odd. This agrees precisely with the orientifold 
discussion. In particular, for an isolated and rational D3 intersecting an orientifold plane, 
the only expected non-universal fermionic zero modes come from h 0,2 (M5). 

Finally consider reduction of the chiral two-form. We label the two one-cycles of the 
T 2 by a and b. Reducing the chiral two-form yields 

A elec = J B + A mag = f g+ ^^ 

Ja Jb 

In the limit that the a-cycle pinches globally over the worldvolume, we may think of the 
electric gauge field as elementary and eliminate the magnetic gauge field. However in 
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general neither can be considered fundamental. The Sl(2, Z) monodromies generally kill 
the one-forms of the T 2 globally, so a single D3-brane in F-theory usually does not carry 
any massless gauge field. Equivalently in terms of the Leray sequence, H°R l is generically 
zero. This agrees with the lib description, where a D3 intersecting the orientifold locus 
yields an 0(l)-instanton. On the other hand if the D3 does not intersect the discriminant 
locus, H°R l is non-zero and we get a U(l) brane, as in type lib. 

Assuming an isolated instanton h 0,3 (M5) = 0, the fluxes all live in /i 2,1 (M5)+/i 1,2 (M5). 
To understand the fluxes we need to know more about h l,2 (M5). Let us look at another 
Leray sequence: 

H^(M5) = H\Mb,Q}) ~ H i (D3,R°TT^ 1 ) + H i - 1 (D3,R 1 n^ 1 ) (4.28) 

Here R° ~ H lfi {T 2 ) <g> O m + H°'°(T 2 ) <g> 1^ 3 . Taking the Sen limit, the (1,0) forms on 
T 2 become sections of the dualizing sheaf up = cjm5 /D3, i-e meromorphic one-forms that 
may have poles along the double point. Here we use P to denote the fiber of M5q over 
D3 which is a rational curve with double point, and P its normalization. We have a short 
exact sequence 

->■ v*ojp ->■ up ->■ C D3 _ ->■ (4.29) 

The map from up to Ods- is the residue map. Taking cohomology along the fiber, we 
get a long exact sequence that implies 

R°ir*co P « £> D3 - (4.30) 

So we can write 

H\D3, RPirtf 1 ) ~ H > i {V3)_ + H 1 > i {V3) + (4.31) 

For R l ir^ujp we will be very sketchy. The rough intuition is that this is generally one- 
dimensional, but can jump up along the locus where the D7-branes are located, because 
the elliptic fiber should further degenerate there. The jump in dimension should corre- 
spond to the number of coinciding D7-branes. Hence we would get 

H i ~ 1 (D3,R 1 ^n 1 ) ~ H 1 ' i - 1 (V3)- + H°> i - 1 (V3) + + H°' i - 1 (V3 C\ D7) ® n D7 (4.32) 

We want to apply this for % = 2. So what do all these pieces correspond to? h 0,2 (V3)- 
corresponds to a U(l) flux on T>3 odd under the involution, but for supersymmetric 
configurations this must vanish. /i 1 ' 1 (X>3)_ corresponds to an odd U(l) flux F of type 
(1,1), which is in principle allowed. Fluxes proportional to H+ and H+ do not exist 
in F-theory. Finally, a flux proportional to H°' t ~ 1 (T>3 fl D7) corresponds to a current 
Je = dx5 2 (H), where £ is the intersection between the T>3 and D7 branes. 

In the lib weak coupling limit, C3 reduces to a 7-brane gauge field Am or the lib 
two-forms Bpp and B^s- The J C3 A dB coupling on the M5-brane reduces to couplings 
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of the form 

/ C 3 AH -)■ f A D7 AJx + (B RR + e-<t>B NS )AF m (4.33) 

Thus the chiral two-form has the right couplings to describe the 37 strings in the lib limit. 
By quantizing 37 strings using RNS we get J E as a fermion bilinear, as we saw earlier. 

Recall that the intermediate Jacobian was defined as H 3 (M5, R)/iJ 3 (M5, Z), and the 
partition function of the chiral two-form was a theta-function on this Jacobian. Since 
the flux lattice splits up into H 2 (V3, Z)_ and if 1 (E,Z), this means that the partition 
function should factorize. One piece corresponds to a sum over fluxes in hi {T>3) on 
the T>3 worldvolume. The remainder is the partition function for the chiral fermions on 
the 37 intersections, which is again a theta-function (equivalently Ray-Singer holomorphic 
torsion). Thus the vanishing behaviour of the chiral two- form partition function is usually 
controlled by the fermionic 37 zero modes in the lib limit. If hi ^ then it could also 
depend on the expectation value of the Brr and B^s- 

4-2. Reducible instantons 

We would like to make some remarks about reducible D3-branes. The situation here 
is very similar to degenerate 7-branes or spectral covers. By Fourier- Mukai transform, it 
is also dual to bundles constructed by extension. 

In the previous section we saw that for an irreducible instanton, the internal part of 
the zero modes is given by Ext p (i*L,i*L) in the upstairs picture. Now suppose that we 
degenerate the D3 to a reducible instanton, with the two reducible pieces intersecting 
over the orientifold locus, either by varying instanton moduli or by varying the ambient 
Calabi-Yau three-fold: 

V3 = D3'UD3" (4.34) 

The sheaf on T>3 is represented by a pair of line bundles 

L 3 = (L 3 ,,L 3 „) fglue (4.35) 

supported on each component. Now generically, even though the support is reducible, 
these two pieces are not independent, but are glued by an isomorphism along the inter- 
section £ 3 / 3 » = D3' n D3": 

fgiue e Hom(L 3 /| s ,L 3 »| s ) or Hom(L 3 »| s , L 3 /| E ) (4.36) 

This gluing isomorphism may be interpreted as the expectation value of a field localized 
on the intersection. The orientifold action relates the two line bundles: 

a*(Ll®K 3 .) = L y , (4.37) 
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Since the orientifold action fixes E 3 / 3 », this means that the gluing map is a section of 

Ll ®a*Ll ®<r*tf 3 '|E3,3„ (4.38) 

or its inverse. We also map f g i ue to its dual, so it must actually equal its dual and 
nowhere vanishing. Then we have L\, |s , „ = i^3'|s 3 , 3 „- Furthermore due to the orientifold 
symmetry we have Ky\z, , „ = i^3"|s , „. From the Calabi-Yau condition it then follows 

1/2 

that -K"3'|s 3 , 3 „ = Kj, ' i ri determines a spin structure on £ 3 ' 3 ». 



1/2 

7 

In this situation the Ext , which counts the universal instanton zero modes, is un- 



'■: 



changed in the degeneration limit. The reason for this is that although the support of 
the D3 becomes reducible, in the limiting configuration the naive zero modes which we 
find on each irreducible piece separately must be glued along the intersection D3' fl D3" . 
As a result there is only one i]}& in the upstairs picture, which is then projected out by 
the orientifold action. Such a reducible instanton has the same number of universal zero 
modes as an irreducible instanton (i.e. four bosonic and two fermionic modes) and can 
contribute equally well to the superpotential. We will call this a reducible 0(1) instanton. 

The number of Ext 1 zero modes could jump, in conjunction with Ext 2 (because the 
Euler character does not jump). We get modes from the 3'3' and 3"3" sectors, subject 
to the gluing condition along the intersection. We also get modes in the 'off-diagonal' 
sectors. Since a* fixes the intersection E 3 / 3 », from our earlier discussion it follows that 
the spinors on the 3'3" intersection live in 

rP(E 3 , 3 „,L 2 , ® K~ 1/2 ® R-} /2 <g> K]! 2 ) ~ fi^E^,^,) (4.39) 

where we used the Calabi-Yau condition to get the second expression. Therefore the 
internal wave functions of 3'3" instanton zero modes (before projection) are counted by 
the global sections of these sheaves. More generally we can use the Ext-groups 

ExtVP&LaO, i.L?) ~ tf (£ 3 ,3'',^3'|s 3 , 3 „) 
Ext 1 (uL 3 >,cr*P(uL 3 >)) ~ H^w^Kvl^,)* (4.40) 

These cohomology groups must have the same rank, as the Euler character does not jump. 
Each generator gives rise to a certain number of bosonic and fermionic zero modes. We 
get essentially the field content of a hypermultiplet in a Dl — D5 system. We have 



H (E3'3",-^3'|e 3 , 3 „) — > X 3 i 3 », £ 3 , 3 „, £ 3 , 3 „ 



The orientifold action exchanges the H° and H 1 cohomology groups, and thus kills pre- 
cisely half the zero modes. 

Let us consider again a reducible brane configuration but without imposing an ori- 
entifold symmetry. It may be that the reducible configuration has additional moduli for 
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modifying the sheaf along the intersection. In particular, let us consider the case where 
the gluing morphism gets turned off. In this case, we end up with a pair of line bundles 
supported on the two components of V3, either 

L 3 = (L y ,L yi <g) e> D3 ''(-£ 3 '3")) or L 3 = (L 3 , <g> D3f {-T^^), L 3 ") (4.42) 

depending on the direction of the gluing morphism. The sheaf L 3 is now rank two along 
the intersection. Notice that with L 3 » = L 3 » <g> (9d 3 "(— E 3 / 3 ") we have 

Ext^Ly^La") = H°(i: 3 , 3 „,Ll^L 3 „\^ l3ll ) (4.43) 

so comparing with (4.36) we see that the gluing isomorphism can be interpreted as the 
VEV of a field on the intersection, as we said earlier. Conversely it shows that the fields 
localized on the intersection do not correspond to deforming the support of the branes. 

In the limit of zero gluing map, one would get extra Ext and Ext 1 zero modes. Again 
this is familiar from reducible 7-branes or degenerate spectral covers, where such a limit 
leads to enhanced gauge symmetry and an extra chiral field. Let us denote the gauge 
generators associated to each reducible branch by (A 3 /,A 3 ») and the chiral field on the 
intersection corresponding to the zero mode Sf g i ue by X. The Ext°'s generate a relation 
among the Ext^s: 

5X = A 3 ,X-XA 3 „ (AAA) 

When X has a VEV, it gets eaten by the vector superfield corresponding to A 3 / — A 3 ». 
In the limit of zero VEV we get massless chiral and vector superfields obtained from 
unhiggsing this massive vector superfield. 

In the present context with D3 instantons, we get exactly the same mathematical 
structure, but we interpret it as a (reducible) U(l) instanton. However turning the Higgs 
VEV on or off looks like an asymmetric operation which is not compatible with orien- 
tifolding. 

When taking a Sen limit, the M5 typically limits to an irreducible D3-instanton, but 
in special cases one may end up with a D3 with reducible support. In particular it may 
happen that b2|z?3 — a 2 so that the M5 will factor into two pieces £ = ±a in the Sen 
limit. It is not easy to follow the gauge fields in the Sen limit, and it seems likely that 
generically we get a reducible 0(1) instanton in the limit, rather than a U(l) instanton. 
If one does get a U(l) instanton, this suggests that 33 zero modes on a reducible U(l) 
instanton get lifted for finite coupling and we end up with an 0(1) instanton in F- theory. 

4-3. Comparison with heterotic 

Let us specifically consider the case of SU(5)gut models. In the neighbourhood of the 
GUT brane Squt, defined by the equation z — 0, the equations for the 7-branes become 
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[8]: 



07: = b 2 = bi + Azb. 



2 — u 5 1" ^"4 
5 



D7: = b 8 = * 5 (fl(&i) + P(6i)«) (4.45) 

Here the 6j are certain polynomials on Squt which specify the local model, and R and P 
in turn are certain explicitly known polynomials in the hi. The lib Calabi-Yau three- fold 
defined by £ 2 = b 2 has non-perturbative conifold singularities at z = b$ = 64 = 0. A 
generic D3 instanton intersecting the GUT brane will miss these singularities. We will 
assume this is the case. 

In the upstairs picture (before orientifolding), the locus z = consists of two pieces, 
£ = ±65, each wrapped by five D7-branes. The intersection of the D3 with the GUT 
brane yields a curve Q in the downstairs picture, and lifts to two copies in the upstairs 
picture, which we denote by Q' and Q". In heterotic/F-theory duals, the curve Q is 
the same curve on which the heterotic worldsheet instanton is wrapped. The curve Q 
typically intersects the orientifold locus, i.e. it intersects the matter curve S 10 on Squt- 

In perturbative lib, the GUT group is U(5), and there are charged 37 modes trans- 
forming in the fundamental of U(5) located on Q'. From the general discussion, the 
number of these zero modes is computed by the Dolbeault cohomology group 

H p (Q',L^®L 7 ®K m \ QI ) (4.46) 

where p — 1,2, and L-j is the U(l) C U(5) line bundle on the 7-brane containing Q'. 
The orientifold action relates this to similar cohomology groups on Q". We can further 
simplify this as follows: if Q is an isolated rational curve, then its normal bundle in Squt 
is typically Oq(—1). As long as Q is not tangential to the branch locus, the normal 
bundle of T>3 is simply the pull-back of the normal bundle to Q in Squt, s° we have 
Kvz\q' = Nx>s\qi = ^x> 3 /qOq(— 1)|q' = Oqi(—1). We will argue in the next section that 
there exist models with Ci(L 7 ) very ample. Thus there are examples where 37 zero modes 
on Q are guaranteed to exist and are even completely chiral, because for sufficiently ample 
L7 the cohomology groups in (4.46) are non-zero for p = and vanish for p — 1. 

Similarly the intersection of the D3-instanton with the flavour D7-brane defined by 
R + Pz = yields another curve that we will call 1Z in the downstairs picture. Its double 
cover is generally irreducible, and we get chiral fermions living on TZ with charge one 
under the U(l) gauge group of the flavour 7-brane. 

Now let us take g s finite. In this case we cannot use the Ganor string approach, and the 
simplest description of the D3 instanton is given by the M5-brane. We immediately see a 
number of differences. First of all there is no analogous formula for the 37 zero modes for 
finite coupling, and in fact as we discussed any vanishing of the partition function is not 
due to zero modes of the chiral two-form anyways. We should probably not have expected 
such an analogous formula, because there is no known higher dimensional analogue of the 
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Bose/Fermi correspondence in two dimensions. The closest relatives to (4.46) appeared 
in our discussion on dP$ fibered M5-branes, where we could reduce the problem to two 
dimensions. There we encountered Dolbeault cohomology groups on Q and £37, and they 
were manifestly different from the Dolbeault cohomology groups we encountered in the 
lib limit. 

Secondly, we found that these heterotic cohomology groups were generically vanishing, 
even when the lib cohomology groups can not be. On Q we had H°(Q, U(—1)\q) where 
U = ® i=1 0(0), and does not yield any zero modes; on £ 37 we found no zero modes 
generically. These facts implied that the chiral two-form partition function is generically 
non-vanishing, but in the lib limit it will vanish due to the 37 zero modes discussed 
above. This shows one has to be careful to stay within the regime of validity of the 
approximations. 

As the notation suggests, the curve £37 (or rather its image under the cylinder map) 
can be thought of to some extent as the curve where ground states of 37 strings are 
localized for finite coupling. In the spirit of [3], suppose we intuitively think of the 
worldsheet instanton as a Dl-instanton in type I, and the lOd gauge fields as living on 
an 5*0(16) 9-brane. Now we T-dualize along the T 2 -fibers of the heterotic Calabi-Yau 
three-fold Z. Then the 9-branes are mapped to 7-branes wrapping the spectral cover, and 
the .Dl-instanton is mapped to a D3-instanton wrapping 7r^ 1 (Q). 

The spectral cover for the 16 of SO (16) has fewer pieces than the spectral cover for 
Eg. For instance if we turn on SU(5)h holonomy, we have the decomposition 

16 = (5,l) + i + (5,l)_i + (l,6) (4.47) 

under SU(5)h x SU(4) x U(l). The intersection of the D3 instanton with the 7-branes 
is given by the union of Q with multiplicity six, and two copies of S 37 (with different 
spectral line bundles). We have already seen that integrating out the physical modes on 
the instanton leads to the theta function of S37, as we would expect when integrating out 
the fermionic 37 strings. 

4-4- Zero modes in the lib limit and U(l) symmetries 

Consider again the IIB limit of one of our vertical D3-instantons, which we assume to 
be irreducible in our discussion, in the case of SU(5) GUT models. In the last subsection 
we saw that its contribution to the superpotential can vanish in the presence of chiral 
matter, even it contributes for finite string coupling. Here we would like to explore this 
behaviour a little more, and expose the role of U(l) symmetries. But first we would 
like to complete the argument that for some suitable choice of flux in F-theory, there is 
necessarily a mismatch between zero and finite coupling. 

To do this we need to have some idea how a flux in F-theory turns into a flux in 
lib. It is hard to follow the flux in the lib limit, but we can make a plausible guess. In 
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heterotic/F-theory duals there is always a canonical flux, that exists for any values of 
the complex structure moduli. Such a flux is constructed using only knowledge of Ci(S) 
and ci(iVg), in fact this is the only discrete data on which the dPg fibration depends. 
To simplify life we may take Ci(iVg) proportional to Ci(S), or even Ci(Ns) = 0. If we 
take such a flux in F-theory, then the U(l) flux on S we recover in the limit ought to be 
some multiple of Ci(S), because no other discrete choices were made. We can even fix the 
precise multiple by comparing the number of chiral generations. Now — K$ is ample, so 
taking L7 to be a suitable multiple of this (up to a half-integer shift to satisfy quantization 
constraints) will do the trick. (This also leads to a large number of generations, but that 
is besides the point here). 

Since C\(S) is ample, it then follows that J Q F 7^ and there is a net number of chiral 
fermions on the 37 intersection which cannot be paired up. As a result, the instanton 
cannot contribute to the superpotential in the lib limit, and naively we would not expect 
chiral zero modes to disappear under a continuous deformation. But from our earlier 
results we know that for generic values of the moduli, the instanton does contribute to 
the superpotential in F-theory or the heterotic string. How could this happen? 

A possible resolution to this apparent paradox can already be seen in our discussion in 
section 2.7. Anomaly cancellation guarantees that there are additional 7-branes intersect- 
ing the GUT brane. In particular our GUT brane is intersected by a flavour D7-brane, 
and the intersection of the 7J3-instanton with this flavour brane yielded a second curve 
1Z with chiral 37 zero modes localized on it. 

By construction, the net G-flux through our M5-brane is zero. In fact as we discussed 
in section 3.3, modulo a small caveat the net G-flux through an M5-brane is generally 
non-zero only if there are gauged shift symmetries of the Kahler moduli. Therefore the 
net flux through the sum of these two curves appearing in the g s — > limit must vanish 
also. It follows that there must also be 37 zero modes of opposite chirality on TZ that 
cannot be paired up. 

Now consider the effective action for these modes on the instanton background. Even 
though the chiral fermions are localized on different submanifolds, we should generically 
expect that they are lifted non-perturbatively. This is familiar for instance from lifting 
of chiral zero modes in Ila/M-theory models [42], which are localized in different places 
on the internal manifold. In the present context, these are non-perturbative effects in the 
effective action on the instanton background, i.e. composite instantons. Indeed, the extra 
£7(1) symmetry on the 7-branes which protects the zero modes at g s = is broken by 
exp(— 1/<7 S ) effects. 

As we lift to F-theory, we cannot really follow the fermion zero modes to finite coupling, 
as there is no higher dimensional analogue of fermionization. We could however follow the 
bosonized fermions to finite coupling, so let us discuss this qualitatively. The analogue of 
fermionic zero modes is a background charge for the chiral two-form. 

The two curves Q and 72. with the "[/(l)-charged" vanishing cycles on top of them 
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yield two distinct four-cycles in the M5 worldvolume for g s = 0. Non-vanishing flux 
through Q and TZ means there is non-vanishing G-flux through these two four-cycles. As 
we extrapolate to finite coupling, vanishing cycles which are charged under the extra U(l) 
symmetry of type lib get related by monodromies, thereby Higgsing the U(l) and giving 
it a mass of order the KK scale. (See section 2.2 of [40] for a discussion of this). Thus 
there no longer is any U(l) symmetry to protect the zero modes. The two four-cycles 
constructed from the two curves Q and TZ with the "t/(l)-charged" vanishing cycles on 
top of them join into a single four-cycle due to the monodromy. The total G-flux through 
any four-cycle in the M5 worldvolume vanishes for finite g s as observed above. Thus there 
is no net background charge and hence no obstruction to pairing up all the fermionic 37 
zero modes seen in the lib limit. This strongly suggests that chiral 37 zero modes will 
generally disappear for finite string coupling. 

Let us ponder the implications of this observation for KKLT like moduli-stabilization 
scenarios. 3 It has been argued in [43] that there is an inherent conflict between the 
presence of chiral matter and instanton contributions to the superpotential. The argument 
can be phrased as follows: gauge groups in type lib are either U(n), 0(n) or USp(n). 
Chiral matter is associated with U(n) groups. In order to get chiral matter, a flux has to 
be turned on for U(l) C U(n). Let us consider the effect of a gauge transformation for 
this U(l). The RR four-form transforms as 

5 X C 4 ~ Ty{\F)5 2 {S) (4.48) 

where S is the four-cycle on which the U(l) is localized. By Poincare duality there is 
some class D in H 2 (X^) such that 4 

/ Tr(F) ^ (4.49) 

JsnD 

Under a U(l) gauge variation the associated Kahler modulus transforms as 

5 x Im(T D ) = 5 X [ C 4 = A / Tr(F) ^ (4.50) 

Jd JsnD 

Therefore a contribution of the form 

d 2 9e- T ° (4.51) 



There are various conceptual issues with these scenarios, most notably the use perturbation theory 
is inconsistent if the number of vacua is indeed finite non-perturbatively. We ignore these issues here and 
only concentrate on perturbative vacua, where we can take the volume modulus arbitrarily large. 

4 Tr(F)/27r should be in the image H 2 (X^,) — > H 2 (S), because we want non-zero intersection with the 
matter curves. 
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is forbidden by gauge invariance. This is the behaviour we saw in the lib limit for £77(5) 
GUTs. It may not be a problem, since in this case the Kahler modulus is in fact eaten 
by the U(l) vector multiplet, but it certainly affects the potential for the Kahler moduli. 

For finite g s this extra U(l) disappears into the KK tower and the 37 zero modes 
can pair up, so there is no U(l) selection rule that could forbid such contributions to 
the superpotential. The longitudinal mode of the massive U(l) is a complex structure 
modulus, rather than the Kahler modulus T/> But one may wonder if we missed some 
effect and there is still some a priori conflict with chirality. 

Since there is no such conflict in the heterotic string, heterotic/F-theory duality pre- 
dicts that there can be no such issue in F-theory either. Let us examine this more closely. 
The Kahler moduli Tq ~ vol(<2 x P 1 ) on the F-theory side can all appear in the superpo- 
tential. The last modulus T ~ vo1(<7b 2 ) looks more problematic; wrapping a D3 on the 
GUT cycle yields a field theoretic instanton and field theory index results seem to indicate 
zero modes if there is chiral matter. However as we discussed earlier in section 3.3, unless 
there are gauged shift symmetries, G\m5 = even in models with chiral matter, so even 
T Q should appear in the superpotential. 

On the heterotic side, a D3 instanton wrapped on o~b 2 corresponds to a space-time 
instanton, and the Kahler modulus turns into the 8d string coupling. So it looks like we 
would have trouble generating an exp(— £) contribution to the superpotential, where S 
denotes the heterotic dilaton. However we could also consider instantons in the second 
E 8 , where gaugino condensation leads to an exp(— £) term in the superpotential. (Strictly 
speaking this contribution is not generated by instantons, but that is not essential here). 
So there cannot be any a priori conflict with chirality. 

We can check this also directly on the F-theory side. The F-theory analogue of this 
is as follows: we may also wrap a D3 at the infinity section of B 3 , instead of the zero 
section. The Kahler modulus for this cycle is T^ ~ T + niTg.. The G-flux through this 
cycle at infinity is zero. There is no need for chiral matter at this location (as we also 
know from the heterotic string, because it corresponds to the second Eg), and so from 
this F3-instanton we can still get a term exp(— To) in the superpotential. 
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